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Chapter 1 

General Introduction 


Disordered Systems is a broad, well established and actively investigated branch 
of statistical physics. The disordered systems we consider in the context of this 
thesis are those whose Hamiltonian encloses some kind of randomness, usually in 
the form of random couplings, fields or topologies. While this definition is quite 
general, it does not encompass the whole discipline, since it leaves aside systems with 
non-random Hamiltonian where the disorder is self-induced [7], such as structural 
glasses. 

Most prominent examples of disordered systems are spin glass models, introduced 
by Edwards and Anderson [8] and simplified by Sherrington and Kirkpatrick [9]. 
The exact solution for the latter mean held modi produced by Parisi in 1979 [10] 
and clarified a few years later [11-13], showed a surprisingly rich phenomenology. 
In such systems the order parameter is a function describing the decomposition 
of the Gibbs measure into an exponential number of pure states, organized in an 
ultrametric structure [13]. 

The analytical techniques developed in those years to solve the mean held spin 
glass, namely the replica and the cavity method, successively refined to deal with 
diluted systems [14,15], proved to be highly effective and general tools. In the last 
thirty years, concepts, analytical techniques, numerical tools and people as well from 
disordered systems found application to a plethora of other scientihc helds: most 
noticeably supercooled liquids [16,17] and combinatorial optimization [18-24], but 
also inference [25-27], protein motion [28], signal processing [29], immunology [30,31], 
neural networks [32-35], metal-insulator transition [36,37], quantum algorithms [38], 
epidemic spreading [39], game theory [40,41] photonics [42], biological networks [43], 
random matrices [44,45], finance [46,47] and random interfaces [48]. 

Also from the mathematical perspective, the effort to rigorously prove the 
results obtained through heuristic physics methods lead to the development of new 
techniques [49,50] and ideas [51,52], 

Another paradigmatic model of disordered system, much discussed along this 
thesis, is the Random Field Ising Model (RFIM). A renormalization group analysis 
shows that disorder is a relevant direction for the renormalization how, and that 
the phase transition is controlled by a zero temperature fixed point [53]. Recently 
this fixed point was showed to be in the same universality class of a critical point 
displayed by glass-forming liquids [54,55]. Another interesting feature of this model, 
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still under investigation, is the breaking down, in finite dimension, of the dimensional 
reduction property that characterizes its mean field version [56,57]. 

One of the heuristic techniques used to deal with disordered systems, the Cavity 
Method, relies on some explicit factorization assumptions, valid in fully connected 
and diluted random graphs only in the thermodynamic limit. In these cases, in 
the non-glassy, replica symmetric phase, the asymptotic free energy takes the name 
of Bethe free energy. In particular, in diluted models, the validity of the Bethe 
approximation relies on locally tree-likeness, that is on the asymptotic absence of 
short loops. Departure from the Bethe free energy is observed in diluted systems 
when the system size is finite. One of the aims of this thesis is to connect the finite 
size corrections to the presence of (few) short loops. The perspective in studying 
this mean field models with finite connectivity, is to apply the same formalism to 
deal with the many short loops one finds in finite dimensional lattices. The basic 
step for a perturbation theory around the Bethe approximation in finite dimension 
are in fact taken in Chapter 8. 

A large part of this thesis deals with disordered Ising models, such as RFIMs 
and spin-glasses, although most of the techniques presented can be generalized to 
others models. The Matching Problem (MP), a combinatorial optimization problem 
with a long standing tradition in the statistical physics community [18,58-62], is the 
other big player of this essay. 

The material presented is organized as follows: 

• Part I : Introduction 

— Chapter 1 : General introduction 

This very same Chapter. It contains a brief introduction to the scientific 
field, states aims and scopes of the thesis, and explains the organization 
of the material with a short overview of each Chapter. 

— Chapter 2 : Preliminaries 

The main concepts and tools recurring throughout the thesis are intro¬ 
duced: the notion of random graphs; disorder systems and the main tools 
that physicists developed to cope with them, the replica and the cavity 
methods; combinatorial optimization problems, as seen from a physicist 
viewpoint; a brief overview of the problem of finite size corrections. 

— Chapter 3 : The Replicated Transfer Matrix 

This is the first original contribution of this thesis. We set up an analytical 
framework to characterize the properties of one-dimensional disordered 
systems. The formalism is based on the spectral theory of the Replicated 
Transfer Matrix, though most results can be rederived using a probabilist 
approach. The main application of the formalism are the computation 
of many types of correlation functions in diluted systems and the com¬ 
putations of free energies of closed and open chains embedded in locally 
tree-like graphs. This last result will be much used in successive Chapters. 
This Chapter is based on the work we published in Ref. [1]. 
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• Part II : Perturbative Finite Size Corrections 

— Chapter 4 : Finite Size Corrections On Random Graphs 

In diluted random graph ensembles the average number of short loops 
is finite also when the number of nodes in the graph goes to infinity. 
Therefore, in this systems, the free energy in the thermodynamic limit 
is that of an infinite tree graph. The first finite size corrections, though, 
resents the presence of these sparse (simple) loops. The computation 
of finite size corrections in diluted random graphs is an analytically 
manageable calculation where the additional contributions of loops to 
the Bethe free energy can be clearly highlighted. This is done in three 
steps: we express the replicated partition function as an integral over a 
certain order parameter; we perform the saddle point computation, which 
gives the leading order Bethe contribution; we compute the Gaussian 
fluctuations around the saddle point. It is then easy to show that the 
Gaussian fluctuations can be expressed as a linear combination of free 
energies of open and closed chains. We carry on this program in two 
different graph ensembles, the Erdos-Renyi and the Random Regular 
Graph ensembles. We published the contents of this Chapter in Refs. [2] 
and [3]. 

• Part III : Non-Perturbative Finite Size Corrections 

Here we discuss two types of finite size corrections that do not arise from 
the presence of loops. The techniques we employ are specific to the problems 
involved. 

— Chapter 5 : The Random Field Ising Model 

We consider magnetic systems with random external fields. In the ferro¬ 
magnetic phase the fluctuations of the field causes a free energy difference 
among the up and down states. Minimization of the free energy on a 
sample-by-sample basis leads to an anomalous 0(1/y/N) subleading scal¬ 
ing for the average free energy. We show how to compute the coefficient of 
this correction using a variant of the replica method with m + n replicas 
constrained to stay in the two different states. The computation can be 
carried out exactly in diluted and fully connected systems. This is the 
content of Ref. [4]. 

— Chapter 6 : The Euclidean Assignment Problem 

We investigate the scaling behaviour of the average cost in the Euclidean 
Assignment Problem, also known as th uclidan Bipartit Matching Problem. 
We show how the difference in the number of blue and red points in a 
small region of space is a source for a transport field. This is formalized in 
a Poisson-like equation that yields a surprisingly ample set of predictions 
for the leading and subleading behaviour and coefficients of the average 
cost, for each dimension d. These results have been published in Ref. [5]. 
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• Part IV : Beyond the Bethe Approximation In Finite Dimension 

We address two different problems in the Euclidean space, where diagram¬ 
matic terms corresponding to simple loops give the first order contribution in 
perturbative expansions around the Bethe approximation. 

— Chapter 7 : The Euclidean Matching Problem 

We first consider the Euclidean (monopartite) Matching Problem. We 
write a replicated action containing the correlations among distances 
between any subset of points. Then we keep only the terms corresponding 
to polygons and we compute them perturbatively. 

— Chapter 8 : The Large M Expansion 

Here we propose a very general method to perform a perturbative ex¬ 
pansion around the Bethe approximation for finite dimensional systems, 
whether disordered or not. The expansion involves an integer parameter 
M. Varying M between infinity and one we interpolate between a ran¬ 
dom regular graph and the original lattice. The first order in the 1/M 
expansion corresponds to the contributions from simple loops. 

In both cases we asses the formal equivalence between these contributions 
and the first order finite size corrections to mean field models. The material 
presented in this chapter has not been published yet and both problems are 
currently under investigation. Therefore these results have to be considered 
incomplete and not polished. 


• Part V : Conclusions 

We finally discuss the results obtained in the previous chapters and highlight 
some directions for future investigation. 

The computation of finite size corrections is the common link between Part II and 
III, while Part IV is the natural follow up of Chapter 4 regarding the characterization 
of loop contributions to the free energy. The discussion over the replicated transfer 
matrix of Chapter 3 will be exploited in several part of the thesis, specifically in 
Chapters 4, 7 and 8. An alternative arrangement of the material would see Chapter 
4 along with Chapter 8 as a unique discussion about loops expansions, and Chapters 
6 and 7 as a Part dedicated to Euclidean matching problems. 

A reasoned history of my doctoral studies would go as follows. At the beginning of 
the first year one of my advisors, Giorgio Parisi, set me to work on the Euclidean and 
the random link matching problems. He was convinced that the term corresponding 
to correlations in triangles in the Euclidean space was the same one arising in the 
finite size corrections in the random link model. I am glad he was right. After 
a few months I was hijacked by Giorgio himself and pointed toward the study of 
finite size corrections on random graphs. In fact the idea there was the same we 
where prosecuting in the study of the matching problem: to relate the finite size 
corrections to the presence of short simple loops. Some time later I discovered that 
this was also a preparatory study, aiming at shaping up analytical and numerical 
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tools, in order to tackle the problem of the large M expansion on lattices. In the 
middle of the second year, the need to better understand the properties of chains in 
random graphs, steamed in a discussion between Flaviano Morone, Tommaso Rizzo 
and me, that led to the work on the replicated transfer matrix. At the end of the 
second year we started working on the bipartite matching problem. The aim was 
to characterize the anomalous leading scaling of the cost in very low dimensions. 
It turned out that the analytical framework we set up predicts in high dimension 
an anomalous subleading scaling, so that I can subsume also this work under the 
umbrella of “Finite Size Corrections". The presence of 0(l/y/~N) corrections in the 
RFIM instead, came as an unexpected surprise from numerical simulations at zero 
temperature on Erdos-Renyi graphs. Fortunately we had the analytical technology 
to deal with it. I devoted most part of the third year to finishing and polishing all 
these projects. In the last part of the year I blew the dust off the replica calculations 
I did on the matching problem in the first year, and did many new ones, to produce, 
along with Giorgio and Gabriele Sicuro, the contents of Chapter 7. Also, according 
to our long thought plan, we are finally focusing more and more on the large M 
expansion. We are confident that, once the formalism is polished, it will provide a 
useful tool to investigate finite dimensional systems. 
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Chapter 2 

Preliminaries 


2.1 Graph Theory 

2.1.1 Basic notions 

In this paragraph we introduce the concept of graph, a simple mathematical structure 
that encompasses encompasses and broadens the commonly known lattices. Most 
statistical physics models we address in this thesis are defined on a (random) graph. 
Graph Theory is a well established subject in mathematics, here we review its basics 
aspects. 

A graph G = (V, E) consists in a vertex set V, usually taken as a subset of 
the natural numbers V = {1,2,...,1V}, such that |V| = N, and an edge set E , a 
collection of unordered pairs of vertices. We will denote with i. j.... the elements of 
V, and with (i, j) and edge between vertices i and j. Elements of E the form (i,i) 
are called self-loops. Multiple instances of the same edge (i,j) are called multi-edges. 
A graph without self-loops and multi-edges called simple. In what follows when we 
write graph we will always mean simple graph. It is common use to call vertices also 
nodes , and to call edges also links. We will use both terminologies indistinctly. 

The neighbourhood of a vertex i is the set of vertexes that have am edge in 
common with i, and it is denoted as di = {j € V : ( i,j ) € E}. The degree (or 
connectivity ) of a vertex i is the number of its neighbours, deg(i) = \di\, and it is 
sometimes denoted as k t . A vertex with degree zero is called an isolated vertex. A 
vertex with degree one is called a leaf or a dangling node. The residual degree of 
a node i is k/ t = k t — 1. The degree distribution pc{k) is the frequency of the node 
degrees, namely 

PG(k) = -Jr = *0> C 2 - 1 ) 

JV iev 

and the mean degree zq is given by 

Z G = if ki = Po(k) k. (2.2) 

i£V k > 0 

A path of length t in a graph is a sequence of vertices w = (*o,such that 
£ E. The path is closed if io = in, and it is open otherwise. If no vertex, 
except for the extremities, is crossed more then once the path is called simple. A 
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closed path can also be called loop or closed chain. An open path is also called 
an open chain. The distance between two nodes is the length of the shortest path 
joining them. A graph is connected if there is a path joining any two nodes. The 
d-neighbourhood of a vertex i is the set of vertexes at a distance at most d from 
i. A graph is called complete or fully connected if any pair of nodes is connected 
by an edge. A graph is bipartite if V can be partitioned in two set such that there 
is no edge joining vertices in the same set. A subgraph of a graph G is a graph 
G' = ( VE ') such that V' C V and E' C E. 

The set E can also be taken to be composed of ordered pairs of vertices, in this 
case the graph is called oriented and the elements of E are called oriented edges or 
arcs, and written in the form (i —> j). Analogous definitions to the ones given above 
apply for directed graphs. 

2.1.2 Random Graphs 
Graph Ensembles 

It is often the case, especially when dealing with complex networks such as the ones 
appearing in finance and biology [63,64], that a particular graph is considered just 
as a contingent realization of an ample class of them. The mathematical structure 
corresponding to this concept is that of random graph ensemble [65]. A random 
graph ensemble G = (<?,P) is a set of graphs Q and a probability law P defined over 
it. The average value of some observable A{G) over the ensemble is then given by 

E[A] = ^ P[G] A(G). (2.3) 

Geg 

As an example, the average degree distribution {pk} is given by and the (ensemble) 
average degree z are defined as 

p k = E[p G (k)} z = E k k , (2.4) 

where E k denotes expectations over p k ■ 

We shall now introduce some random graph ensembles commonly used in statis¬ 
tical physics and other disciplines. 

• G ER (IV, p): the Erdos-Renyi (ER) ensemble. 

Historically, this is the first random graph ensemble ever proposed, marking 
the beginning of random graph theory [66]. It is also the most simple one. 
Each graph of the ensemble has N vertices and can be sampled as follow: start 
with a graph with N vertices and no edges, then for each of the (") pairs of 
vertices independently add an edge with probability p. Calling M the number 
of edges corresponding to a graph G, the law of the ER ensemble depends only 
on M and is thus given by 

p[G] = p M (l -p)^)- M . (2.5) 

If p is scaled as p = fj, in order for the nodes to have finite connectivities, 
taking the limit N —> +oo we have that 



kl 


Pk 


r\j 


( 2 . 6 ) 
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that is, the degree is Poisson distributed with mean c, that is z = c for large 
N. 

In order to sample a graph from the ER ensemble it is convenient first to 
extract M from the appropriate binomial distribution, then to assign each of 
the M edges to a pair of nodes. This procedure requires O(N) operations, 
while choosing each potential edge with probability p would require 0(N 2 ) 
operations. 

• G krg(N,z): the Random Regular Graph (RRG) ensemble. 

The measure of this ensemble is uniform over all the graphs with N vertices 
where each vertex has connectivity z [67]. Graph with this property are called 
regular. Notice that in order for the ensemble to be non-empty N z has to be 
an even number. Sampling of graphs in the RRG ensemble is more involved 
than in the ER ensemble. 

An exact sampling method was proposed by Bollobas [68], and goes under 
the name of configuration model, although we reserve this name to the more 
general ensemble and generative procedure we present next. Here we resume 
Bolloba s’ procedure. Start with a set of Nz elements, called stubs or half-edges, 
and partition them in N subset containing z stubs each and representing the 
nodes of the graph. Pair the stubs at random (they are even), that is choose 
uniformly at random a matching among them (see also Sec. sec:prel-matching). 
Construct the graph associated to this particular pairing (sometimes called 
"configuration"). Repeat the pairing procedure until the resulting graph has 
no self-loops and multi-edges. It is easy to show that this contruction induces 
a law that is uniform over all regular graphs. It is very slow though, and it is 
exponentially slower as the degree increases, as we will discuss in Paragraph 
2.1.2, due to the fact that the probability of obtain a non-simple graph after a 
matching is finite. 

An alternative method, proposed in Ref. [69], is less computationally expensive 
at the expense of provably yielding a uniform measure only in the infinite graph 
limit. The method is a slight and reasonable variation to Bollobas’s one. One 
starts matching pairs of stubs one by one at random, and if at a certain step a 
self-loop or a multi-edge is produced, only this last matching is discarded and 
a new one is proposed, instead of starting over the entire matching procedure. 
If during the procedure no feasible pairing remains available the graph is 
discarded and the procedure restarts with a new set of unpaired stubs. 

This is the method we use throughout the thesis to generate random regular 
graphs. Since we deal with finite size correction we took care to check that 
this heuristic that does not produce biases in our numerical estimates to the 
relevant (i.e. 0(1/N)) order. 

• Gconf(IV, {fcj}^): the configuration model. 

This graph ensemble has uniform measure over all the graphs of N nodes 
where the node i has degree k t . Notice that this definition is non-trivial only 
if ki is even. The degree distribution in this ensemble is the same for all 
graphs and G CON f is sometimes named arbitrary degree distribution ensemble. 
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Both the exact and the approximate sampling procedure for this ensembles 
are the straightforward generalizations of the one given for the random regular 
graph ensemble. On the other hand G rrg is just a particular instance of the 
Gconf ensemble. 

Alternative definition can be considered for this ensemble, for example vertex 
degrees could be independently generated from a distribution {pk} instead of 
being fixed to {ki}. 

Random graph theory, and statistical physics as well, is often concerned with 
the properties of ensemble in the limit of large N, that we will call the large graph 
limit , therefore we will assume the existence of a prescription for the scaling with 
N of the parameters defining the ensembles, such as p in G BR (IV,p) and {ki} in 
G CONF (N,{ki}). In what follows we will be interested mainly in sparse random 
graph ensembles , that is ensembles with finite average degree z in the limit N f oo. 
Therefore, for instance, we will assume the edge probability p in G ER to scale as 
P = to achieve sparsity. 

Beyond sparsity, a property possessed by finite dimensional lattices as well, some 
peculiar features characterize the ensembles we presented above. One of them, very 
convenient for their analytical investigation, is the property of being locally tree-like. 
We will give a more precise definition of locally tree-likeness in Paragraph 2.1.2, the 
basic idea though is that a ball of finite size centered on a randomly chosen node 
does not contain any loop with a probability that goes to one as N goes to infinity. 
In this sense the random graph is locally a tree. As discussed in Paragraph 2.1.2, 
loops of finite length are rare in random graphs. 

Since we mainly discuss the large graph limit, let us define for convenience the 
symbol ~ as 

f(N)~g(N) <=*► f(N) = g(N) + o( 1) as IV t oo. (2.7) 

Hereafter we will refer to G as to one of the ensembles above in the large N limit. 

Asymptotic properties depended only on the degree distribution {pk}, due to 
the lack of additional constraints in the definition of the ensembles. For example 
it can be shown that the ensemble G ER is asymptotically equivalent to G ER with 
Poissonian distributed {ki}. More refined random topologies where utter local or 
global properties can be devised (e.g. assortativity [63]), their analysis is usually 
more involved though. 

Let us define the random variable edge perspective degree k , of a node chosen as 
follows: choose uniformly at random one of its edges from a random graph G in G 
and let k be the residual degree (i.e. k = k — 1) of one of its extremities. A little 
thought shows that the probability p k of obtaining a certain residual degree k is 
proportional to k + 1 and to the number of nodes having degree k + 1. Therefore, 
for the edge perspective degree distribution { p k }, and its average edge perspective 
degree 5, that we also call residual degree distribution and average residual degree, 
we have 

P~k~ lp~ k+ iC k + 1 ) z = E~ k k, (2.8) 

where Er denotes expectations over pr. For Poissonian random graph z = z, while 
for RRGs z = z — 1 trivially. 
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Sparse graph ensembles G enjoy some powerful factorization properties due to 
the large graph limit. For example, if we choose uniformly and independently at 
random a n nodes i \,..., i n , their joint degree distribution factorizes as follows: 

n 

P[deg(?'i) = h ,... ,deg (i n ) = k n ] ~ P[deg(i m ) = k m \. (2.9) 

m =1 

Also the joint degree distribution of nodes in a finite neighbourhood of a given 
node factorizes. The local structure of finite neighbourhoods will be discussed in 
Paragraph 2.1.2. 

The features we discussed have very important consequences to the analytical 
treatment of sparse random graph ensembles, in fact they are the among basic 
assumption on which the Cavity Method relies. We point the reader to Ref. [15] for 
a more in-depth discussion of all these arguments. 

Giant Component 

An outstanding feature of our sparse random graphs ensembles is the existence of a 
sharp threshold, depending on the first two moments of the degree distribution, and 
in particular only on the average residual degree z, above which a giant connected 
component arises. For some values of the parameters defining a graph ensembles in 
fact, the almost sure presence of a unique connected component, which contains a 
finite fraction of the nodes, can be rigorously proven [70]. Below that threshold, it is 
possible to show that w.h.p. only tree-like components exist, thus almost any graph 
sampled from G is a forest. 

We will give an heuristic argument, which holds to for large graphs, to explain 
this phenomena. This the first cavity argument we present in this thesis, and it goes 
as follows: consider a uniformly chosen vertex i from the random graph G and call 
m the probability it belongs to a giant component. Notice that according to this 
definition rriN would be the average size of the giant component. The node i is not 
in the giant component if no one of its neighbours is in the giant component once 
the node i has been removed from the graph, that is once a cavity is formed. We 
call m cav this probability for one of the neighbours to belong to the giant component 
in the cavity graph. In the large graph limit we can write 

1 - m = E k (1 - m cav ) k , (2.10) 

where in the r.h.s. we exploited the factorization of the joint probability distribution 
in the cavity graph. We can then write a self-consistent equation for m cav reiterating 
previous argument: 

1 - rn cav = E~ k (1 - m cav )^, (2.11) 

where the residual degree k is considered. Last equation always admits the solution 
m cav = 0. It turns out, as it can be easily seen expanding Eq. (2.11) for small 
m cav , that a second solution exists for 5 > 1, and disappears continuously for 5 < 1. 
Therefore the threshold condition for the emergence of a giant component is given 
by 


z c — 1 . 


(2-12) 
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Simple loops distribution 

As already stated, and as discussed more in depth in the next Paragraph, sparse 
random graphs have the local structure of a tree in the large N limit. Still a finite 
number of loops with finite lengths, therefore containing a finite number of nodes 
although a null fraction of them, survives the limit. These loops are simple, that 
is non-intersecting. It can be proven [67,68,71] that, given a set of non-negative 
integers the joint distribution of the number of simple loops for large N is 

given by 

e~ Xe \ re 

P [{?7 simple loops of length ~ ]^[-p-. (2-13) 

£>3 r£ ' 

Therefore the numbers of loops of lengths t are Poissonian independent random 
variables, with mean 

A, = I' < 2 - 14 > 

~£ 

A simple heuristic argument can be given to understand the mean value T. In the 
setting of the configuration model consider the probability of two randomly chosen 
nodes, io and i\, to be connected by and edge. Calling ko and k± the degree of the 
two nodes, to the leading order in 1/N each of the ko stubs of io tries to connect 
independently at random with one of the k\ stubs of i\ over the zN total stubs. 
Therefore the probability of the edge is given by 

P[(i 0 ,ii) € E\ = Y, PkoP^ko^ + ° 

k 0 M (2.15) 


Now consider the probability of the existence of a randomly chosen open path 
(io, i\, i‘i) of length two. We have a factor ko accounting for the outgoing stubs from 
io, then a factor k\/zN to connect to ii, then ki — 1 ways to depart from i\ and a 
factor k 2 /zN to connect to % 2 - In the end 

P[{(*0,*l),(il,*2)} c E\ = Y, Pko Pki Pk 2 ko h{k : N — ^ + o 

ko,ki,k2 * ^2 16) 

Extending the above reasoning to the probability of existence of an open chain of 
length d we straightforwardly obtain 

zzX l / l \ 

Pfopen chain of length l] = + ° • ( 2 - 17 ) 

The number of different paths is given by the way of choosing i + 1 nodes, N\/(N — 
t — 1)! divided by a factor two accounting for path reversal symmetry, therefore 

Z z l ~ v 

E[# open chains of length t] = —-— N + 0(1). (2-18) 
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The computation of the probability of existence of a certain closed path 

z 1 / i \ 

P[ closed chain of length t \ ~ + O f ^ +1 j (2-19) 

Sine a simple loop of length l contains t nodes and has 2£ has a symmetry factor, 
we finally have 

z l 

E[# closed chains of length i\ ~ —, (2.20) 

where we have recovered the results expected from Eqs. (2.13) and (2.14). The 
factorized Poissonian form of the loops’ joint distribution is due to the asymptotic 
independence of this rare events. 

Also in this framework an important result regarding the configuration model 
can be simply understood. In the large N limit, the probability that the graph 
induced by a random pairing is simple is given by [67] 

- -2 

impairing is simple] ~ e - 5~w. (2.21) 

This formula can be seen as an extension of Eq. (2.13) to loops of length 1=1 and 
l = 2 (self-loops and multi-edges), and in this sense it is just the probability for the 
graph to contain n = 0 and r 2 = 0 of them. 

Notice that at finite N the maximum length of simple loops is limited by N 
itself. Moreover probabilistic arguments such as the one leading to Eq. (2.13) fail as 
soon as ~ N, that is for lengths greater then l ~ 

Local weak convergence 

Here we define one of the most important characteristic of sparse random graph 
ensembles, that of being locally tree-like, in a sounder mathematical framework. In 
these ensembles in fact almost any finite neighbourhood of a node is isomorphic to a 
random tree in the large graph limit. To accurately define this property we have 
to go through some definitions. We will follow the analytical framework proposed 
by Aldous and Steele [50], since it provided very useful in turning Cavity Method 
predictions to rigorous results. 

Let G* be the class of graphs with a countable (also infinite) number of nodes 
and a distinguished node that we call root. We will define a notion of convergence of 
elements in G* through which we will infer a topology on G*, so that we get to use 
all the instruments from weak convergence theory. For G£G» let us call BfiG) the 
/-neighbourhood of its root. 

Definition 1 (Convergence in G*). Let {G n } be an infinite sequence of elements of 
G*. We say that {Gn} converges to G^ if for each integer l there is a ni such that 
Bi(G n ) is isomorphic to for each n > ni. 

It can be shown that it is possible to provide G* with a topology compatible with 
this notion of convergence, such that it becomes a complete separable metric space. 
As a consequence all the tool of weak convergence theory apply and we denote weak 
convergence of measure on G* as ji n —> //. 
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Let Gat be one of the ensemble of paragraph 2.1.2. Let {Gat} be a random 
sequence of graphs in G* sampled from Gat, with root selected uniformly at random. 
Denote with {pn} the corresponding sequence of laws. We call {X}} a random 
sequence of trees of increasing depth l that we define inductively. To has a single 
node io. Tj is constructed from To extracting ko from {pk}, adding ko nodes and 
linking them with io- We call these last nodes children of io- We build T 2 extracting 
independently for each children i m at the first level k m new children, sampled 
from {pk}, at the second level and linking them with i m . Each successive level is 
constructed analogously, leaves of the preceding level sprouting independently a new 
offspring according to an edge-perspective degree-distribution {ph}- 

Let us call T the random limiting object of {Tj} and p its law. Graphs sampled 
from the ensemble Gat are then said to be locally tree-like, as it can be proved that 
Pn p (i.e. they are locally isomorphic to a random tree). With a little abuse of 
notation we could state this as Bi( Gat) = Bi(T) = 7} for large N. 

2.1.3 Factor Graphs 

In order to introduce the Cavity Method, an useful analytical tool to deal with diluted 
disordered systems, it’s convenient to make use of the factor graph mathematical 
structure (it’s not mandatory though, we could have resorted to ordinary graphs 
with a little more effort and clumsiness). Factor graphs allows us to model a great 
variety of inferential statistic problems [15] [72] and are the natural set for the Belief 
Propagation (BP) algorithm we are going to introduce in the next paragraph. They 
are used in statistical physics as a graph representation of the geometrical structure 
(defined by their interactions) imposed on a set of variables. 

A factor graph is an ordered triple G = (V, F, E ), where V is the set of variable 
nodes (without loss of generality we take it to be [N]) and F is the set of function 
nodes (for us will be F = [M ]). E is a set containing ordered couple (i,r) such 
that i G V and r £ F, so that E C V x F. We will generically call nodes elements 
of both V and G. To easy the notation we will use the letters i,j, ... for variable 
nodes (that we shall also call variable nodes) and r, s, ... for function nodes (f-nodes). 
In summations or productories where dummy indices i or r are present without 
further specifications, they are intended to run over the sets V and F respectively. 
Factor graphs can be subsumed in the contest of ordinary Graph Theory as bipartite 
graphs and from Graph Theory we shall import definitions and results. We call 
neighbourhood of a variable node the set di = {r G F : (i, r) 6 E} and neighbours 
its elements. The degree of a node is the number of its neighbours. We write 
unambiguously i G r to mean in i e dr. We call v-neighbourhood of i the set of 
variable nodes having a common neighbour with i. Specular definitions hold for 
f-nodes. A path between nodes is a sequence of edge P = (ei, e-i ,..., e p ) such that 
two consecutive edges share a common node and it length is the number of edge it 
contains (p for P ). The distance between two nodes is the length of shortest path 
such that the first and the last edge contain respectively the two nodes. With this 
definition neighbours of a node are simply nodes at distance one from it and we can 
define an /-neighbourhood of a node as the set of nodes at distance at most l from 
it. A loop is a path that start and ends with the same node and a tree (we will see 
the importance of this definition) is a factor graph without loops. 
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Fig. 2.1. 

model. 


Visual representation of the factor graph associated to the bidimensional Ising 
Black squares are function nodes, white circles are variable nodes. 


Having gone through the definitions, we want to relate the abstract mathematical 
structure with actual (physical) problems. To do so we extend the factor graph 
definition to that of graphical model , that is a factor graph with variables Xj associated 
to its variable nodes i, taking values in a set X (that we shall suppose to be finite), 
and real-valued function i/j r associated to each f-node r and taking as argument the 
variables associated to its neighbours. If we write x r = {xi : i 6 r} for the argument 
of ip r and x for the entire set of variables associated to G, for a generic graphical 
model (that we shall also call G for convenience) we can express the probability 
density distribution as 


Mg(x) 


Ifc M*r) 

Z G 


( 2 . 22 ) 


Z G is a normalization factor that statistical physicists will interpret as the partition 
function. Vice-versa to each probability density of type (2.22) (that is every one, 
but the corresponding factor graph could be trivial in some cases) we can naturally 
assign a graphical model. We arrived then to a probabilistic interpretation of a 
factor graph structure, where f-nodes represent ‘interaction’ among variable nodes 
neighbours. As an example, in a Ising spin model (see Fig. 2.1) the interaction term 
would be 

tpijix^Xj) = e pJXiX G (2.23) 


The utility of factor graphs has been discovered by statistical physics community 
thanks to the success of Cavity Method in solving computational problems (random 
K-Sat for example) that couldn’t be modelled on ordinary (non bipartite) graphs 
. Sometimes we will use the term graph instead of factor graph when the context 
allows no ambiguity. 


2.2 Spin glasses and Random Fields 

Archetypal example of disordered systems are spin glasses and random fields models. 
Here we will briefly describe their phenomenology. For a broader discussion we point 
out to the reader Refs. [13] and [73]. Both models present disorder in the form of 
some kind of randomness encoded in the Hamiltonian: random couplings for spin 
glasses, and random external magnetic fields for random field models. This kind 
of disorder, that can be thought as to correspond to very slow (frozen) degrees of 
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freedom, goes under the name of quenched disorder. The free energy of this system 
depends on the particular realization of the disorder. One is then usually interested 
in the average properties of this system, the most relevant one being the average 
free energy 

/ = E/ sample = - -^E In Z aample , (2.24) 

where E is the average over the disorder. Some observables O in disordered systems, 
most noticeably the free energy, have the self-averaging property, that is the relation 

lirn P(\0 — EfO]I > e) = 0, (2.25) 

N-t+oo 

holds, therefore almost any realization of the system has the same value of O in the 
thermodynamic limit. 

Spin glasses are statistical mechanics models of magnetic systems presenting 
competing interactions, at odd with the purely ferromagnetic usual ones. In this 
thesis we will deal with the Ising spin glass, where the dynamical variables are binary 
(Ising) spins {o"i}iLi taking values in {—1,+1}. Although binary variables provide a 
drastic simplification to real systems, Ising models are widely recognized to be able 
to catch in many cases most qualitative aspects of real systems. Generalizations to 
vectorial spins go under the name of Heisenberg models. Given a graph G = (V, E) 
as the underlying topology of the model, we associate to each edge an interaction 
Jij extracted independently at random according to some distribution P(J). The 
single sample, {Jjj }-dependent Hamiltonian is then given by 

PAW}} = ~ ^2 JijViVj -h^ai (2.26) 

(*d) * 

and the corresponding (random) partition function is 

Zj = Y / e~ 0Hj[W}] (2.27) 

M 

If P(J ) has support only on positive reals the model is called a disordered ferromag¬ 
netic model, while if ,J t] can take also negative values we call it a spin glass. We call 
frustration the presence, in a given sample, of simple loops such that the product of 
the signs of Jij along the path is —1, meaning that it is not possible to satisfy each 
bond, i.e. to find a configuration {cq} such that OiJijGj = 1 along the frustrated 
loop. Frustration is the distinguishing feature of spin glasses , and the cause of some 
of their peculiar features, such as degeneracy of ground states and computational 
hardness. 

The correct solution of the fully-connected spin glass model (the Sherrington- 
Kirkpatrick (SK) model) was obtained by Parisi [10] within the replica method, 
through a peculiar scheme to escape the symmetry of the action under replica permu¬ 
tation. This approach, called (Full) Replica Symmetry Breaking, beside yielding the 
correct value for the average free energy, hinted to a deep probabilistic structure of 
the SK models, clarified in the following years. Below a certain temperature T c the 
system enters a disordered glassy phase, characterized by the slowing down of the 
dynamics, slow decay of correlation functions, presence of an exponential number of 
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pure states. The complexity of states, ergodicity breaking, ultrametricity, stochastic 
stability, slowing down of the dynamics,became central concept to the analysis of the 
SK model. We point to Refs. [13] and [52] for a detailed discussion of the argument. 
Finite dimensional spin glass on the other hand are a much open problem. Two 
competing theories, one inspired to the solution of the SK model, the other, the 
droplet theory, to domain based arguments, depicts two very different scenarios for 
the thermodynamic phase under T c . Replica symmetry breaking advocates support 
the existence of a spin glass phase with an exponential number of pure states [74], 
while the droplet community claims that only two symmetry related pure states 
exist [75]. Monte Carlo numerical simulations, plagued by the extreme slowing down 
of the dynamics, have not given yet conclusive results, despite the intense effort of 
the last years. 

Another class of disordered systems is that of magnetic systems in a random 
external field. The prototype of these systems is the Random Field Ising Model 
(RFIM), defined by the Hamiltonian 

Wh [M] = -J ^2 ViVj ~ (2.28) 

(m) * 


with J > 0 and {hi} independent identically distributed random variables E h t = 
0, E hihj = Sij A 2 . The control parameters for the system are the temperature 
T and the ratio r = (j. A simple argument, due to Imry and Ma, shows that 
the lower critical dimension for the system is di = 2. For d > 2 in fact there is 
a critical line r c (T ) in the r — T space separating the paramagnetic phase above 
from a ferromagnetic phase below. For pure ferromagnetic systems instead the 
lower critical dimension is di = 2. While there was some argument in favour of a 
spin glass phase for some values of the parameters [76,77], this possibility has been 
recently excluded [78]. Another interesting conjecture, based on a supersymmetry 
argument [56], concern the equivalence to all order of perturbation theory of random 
field systems in dimension d with pure systems in dimension d — 2. This equivalence 
is called dimensional reduction, and it would predict a lower critical dimension di = 3 
at odd with the rigorous result di = 3. Therefore dimensional reduction breaks down 
at least at low dimension. Recently some authors, using a functional renormalization 
group approach, proposed the value d* ~ 5.1 as the lower critical dimension for the 
validity of dimensional reduction [79]. In the RFIM disorder is a relevant direction 
for the renormalization group flow, and the phase transition is controlled by the 
zero temperature fixed point [53]. In-depth discussions of the RFIM can be found in 
Refs. [80] and [73]. 


2.3 Replica Method 


Replica method is a powerful analytical tool to address systems with quenched 
disorder [13]. The necessity of its use steams from the difficulty in averaging the 
random partition function Z as argument of the logarithm in 


/ 


1 

Jn 


Eln Z. 


(2.29) 
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Its main ingredient is the mathematical identity 

Z n — 1 

lim- = InZ, (2.30) 

n-> o n 

such that we can write 

/ = lim- lnEZ n . (2.31) 

J n->o n/3N K ’ 

Computation of E Z n is then performed for integer n, since this case is mathematically 
tractable. One therefore introduces n copies of the system, called replicas , having 
the same disordered in the Hamiltonian. Computation is then carried out, usually 
introducing an order parameter and performing a steepest descent evaluation point 
in the thermodynamic limit (N f oo). The n 0 limit is finally taken, yielding the 
average thermodynamic free energy. There are some faulty steps in this approach, 
preventing it from being rigorous: analytical continuation to n = 0, which is not an 
accumulation point; exchange of the limits n 0 and N f oo; saddle point evaluation 
is always performed in a restricted subspace, defined through some symmetry related 
ansatz), since minimization of the action in the full parametric space is infeasible. 
Nonetheless replica method has proved to be an highly effective method and some 
of its predictions where proved to be right (sometimes decades later), while none to 
be wrong. 

Throughout this thesis we will give numerous examples and applications of the 
replica method , namely in Chapters 3,4,5,7 and 8, therefore we will not go to great 
detail in this paragraph. 

As an example of the method, the replicated partition function of the Sherrington- 
Kirkpatrick spin glass model, after an Hubbard-Stratonovich transformation and 
summation over the the replicated spin configurations, for large N is given by 


EZ r 


II ^Qab 


,-ns[{q}] 


a<b 


where the replicated action is given by 


S[{q}} = -n^~ + ^E^-ln e 


(2.32) 


(2.33) 


a<b 


The order parameter here is the n x n zero diagonal symmetric matrix {o'ab} , for 
a total of n(n —1)/2 degrees of freedom. In order to make the analytical continuation 
to real n, a explicitly n-dependent ansatz for {q^} has to be proposed. The most 
simple one is to the Replica Symmetric (RS) ansatz, and assumes independence of 
the saddle point value of q a b from its indexes, that is q a b = q for all a,b,a ^ b. The 
RS ansatz is usually exact on fully-connected or locally-tree like topologies in the 
high temperature phase. In spin glass systems though, below a certain temperature 
T c a more complicated ansatz that goes under the name Replica Symmetry Breaking 
(RSB) is needed. This low temperature phase is called the spin glass phase. In this 
thesis we will deal only with RS systems, therefore we point the reader to Refs. [13] 
and [15] for an in-depth discussion of the broad phenomenology of the spin glass 
phase. 
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As a final note we want to discuss the equivalence between to alternative de¬ 
scription for the order parameter in Ising model on diluted systems. One can choose 
as a set of order parameters the multioverlaps {q ai ... Q }, with p > 1, expressing 
correlation among replicas according to 


9ai = 

i 

Qaia 2 = ^53 E K 1<r ? 2 ) 
i 

Qai...a p = ^Z] E K ai -'- a *“ P ) 


(2.34) 


where {s} },..., {erf} are the thermally independent replicas and (•) is the thermal 
average. In fully-connected systems only the first two moment q a and q a b are 
needed to have a complete description of the system, since due the central limit 
theorem effective fields acting on replicas are Gaussian distributed. An example of 
multioverlap description is given in the matching problem of Chapter 7. Although 
the problem is set on a fully-connected graph it acts effectively as a random diluted 
graph, since only a small fraction of costs contributed to the relevant configurations. 

The other possible description of replicated diluted system, and the on we employ 
most often during the thesis, is the one given by the order parameter p(a 1 1 a 2 ,..., <r n ), 
a real or complex valued function of the 2 n = |{—1, l} n | replicated spin configurations. 
Throughout the thesis we will use the notation p(a) = pier 1 , ..., a n ) and we will 
refer to p{a) also as a vector with 2 n components. The function p(a) is related to 
the multioverlaps {q ai ...a v } by 

q ai ...a p = E p(<r)<r ai ---<T ap - (2.35) 

cr°l,...,cr a P 

The Replica Symmetric ansatz for this two sets of order parameters corresponds, 
with a little abuse of notation, to pis 1 , ..., cr n ) = pQCf=i & a ) and q ai ...a p = c p . 

2.4 Cavity Method 

2.4.1 Belief Propagation 

Cavity Method has been developed in the context of mean field glass theory [13] as 
an alternative to the Replica Trick approach and turned out to be very effective in 
tackling statistical models on locally tree-like structures. It is a generalization of the 
long known Bethe-Peierls approximation and it’s main idea, used in different forms 
and in different scenarios [13] [15], is that properties of a system of large size do not 
change too much if the system is increased by a single element. Following [15] we 
will take an algorithmic approach introducing the Cavity Method through Belief 
Propagation, a message passing algorithm on single instances of the problem, and 
we will deal with random instances in the next paragraph. Belief Propagation (BP) 
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is a message passing algorithm on a generic graphical model (G, {Vv})- It gives an 
estimate of p probability distribution marginals that is correct for tree factor graphs 
and has proved to be fairly accurate on some models with long (or even short) loops 
and short range correlations. If BP equations admit a unique fixed point, BP fixed 
point messages can be used to calculate the so called Bethe approximation to free 
energy. 

Let’s define p distribution marginals as 


K*) ieV-, 

*£y\z 

Hr{x r ) = Y M x ) r G F; 

%V\dr 

Ha(x a ) = Y M x ) A cV. 

X V\A 


(2.36) 


We then introduce the aforementioned messages, that is we assign to each 


( i,r ) e E two probability distributions, and / 4->r( x ’*), over the space X, 

where index t denotes t -th iteration of the BP algorithm we are going to define. 

BP update rules are local, messages at time t + 1 at each edge are calculated 
from messages at time t on adjacent edges. We write the BP update rules, also 


.(*) 


(2.37) 


known as sum-product rules as 



"rliiXi) 

~ Y ^r{.X r 

) II ■r ^ X .i 


X r \i 

jer\i 


= n PXi 

(■ Xi )• 


s£i\r 



Symbol = denotes equivalence up to a constant factor given by the normalization 
condition. 

Starting from a given initial condition {}, that could be the uniform dis¬ 
tribution over X (i.e. o-°j r (x t ) = yYj), one could ask himself if Eq. (2.37) leads to 
some limit distributions at finite t or as 1 1 °o. As a complementary point of view 
we can search for solution of 


L'r—tii.Xi) — 'y ) L’r (Xy ) 11 Vj^, r (Xj ), 
x r\i j&r\i 

l^i—^r^Xi) = | | Vs^yiixi) , 
s£i\r 


(2.38) 


fixed points of dynamic (2.37), and study their stability and their attraction basin. 
We notice that a probability distribution over a finite set of \X\ elements can be 
parametrized as a point of the | A|-dimensional simplex, so distribution limits are 
well defined using equivalent norm in these spaces. 

The BP estimate of marginal ^ after t iterations is given by 

^(*0 = 11 ( 2 - 39 ) 

A first taste of the consistence and utility of these definitions is given by the 
following fundamental theorem: 
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Teorema 1 (BP is exact on trees). Let (Q. {Vv}) be a tree-like graphical model with 
diameter i*. Then: 

1. For any initial condition BP messages converge to the unique fixed point in 
i* + 1 iterations at most. 

2. Fixed point messages yield an exact estimate of marginals, n*(xi) = [ifixi) Mi £ 

V. 

Proof. In tree-like graphical models BP it’s just a clever way to sum over variables 
in the partition function, beginning from leaf and down to the root. Let denote 
the connected component including variable i once removed (i, r ) from G. We shall 
call tfii —> ?’) the depth of %^ r - 

We are going to prove that, for each number of iteration t > tfii —> r), message 
vf\ r converges to the marginal distribution of i in the graphical model 7i-s. r . It 
follows that for each t > every marginal is exactly computed. Proof proceeds 
by induction on tfii —>■ r). The first step is trivial: Ti^ r is composed by the single 
node i, tfii —>?’) = 0 and its marginal distribution in given by (2.39) is equal 
to vf\ r = Mt > 0 in the original model thanks to (2.37). Let our assumption 
hold true for t*(i — > a) < r and let’s prove it for f*(z — > r) = r + 1. Nodes j £ s\i, 
with s £ i \ r, are the roots of subtrees with depth r at most, therefore we can use 
our inductive hypothesis and for t > t messages \n^ s } correspond to marginals on 
respective subtrees. Putting in {i/j < ^ >s }(2.37) and thanks to (2.39) they grant the 

exact marginal of i in which is the message ^ ie original model. This 

completes the proof. □ 

Since f* < N, once fixed the root i, assuming the time to the neighbours of a 
given node a to be of order 0(deg a ) and taking the factor graph to be a uniformly 
sparse tree, we found an algorithm of complexity O(N) to exactly compute the 
marginal gi iterating BP equations only for messages descending from leafs to the 
root. This is a huge leap forward compared to the naive approach of summing over 
xy\i variables which takes Od^j^ -1 ) operations. Moreover even on factor graphs 
with loops often BP estimates get to be fairly accurate, and especially so when 
length of loops are of order 0(log(IV)), as in the ensemble we are going to study, 
and no long range correlations arise. Even in same cases where many short loops 
exists, such as in the two index assignment problem, BP has been proven to yield 
exact results [81]. 

Preceding theorem could be generalized as follows, still on tree factor graphs: 
given A C V, let Fa = {r £ F : dr C A} and dA = {r £ F : dr n A 0} \ Fa- Then 

Ta{xa) = I] MXr) II * > r-rt(r)(*i(r))> ( 2 - 40 ) 

r£dA 

where i(r) is the unique variable node of A neighbour of the the f-node r £ dA. 

Update rule (2.37) can be often simplified taking into account the symmetries 
and the structure of the considered model. When the alphabet X is composed by 
two letters, that is variables can take only two values, probability distribution over 
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X ( and messages in particular) can be parametrized by a single real number. For a 
given parametrization Eq. (2.37) can be recast as equations involving multivariable 
real functions, much more analytically and numerically amenable. A typical choice 
for Ising-like systems (X = {—1,1}) is 


h (t) . = — log 
2(3 8 


"rXii- 1 ) 


(2.41) 


and the new messages {h^^} acts as effective magnetic field on spins. 

On a tree-like factor graph ensemble G we are mainly interested in the distribution 
of messages over the whole graph, that we denote with .P(z>). In the large graph 
limit we can associate to BP equations (2.37) a distributional recursion rule 


C Dj 


= E j 8(i> - fnttfisj})) f[ II (2-42) 


j= 1 S=1 


that goes under the name of Density Evolution (DE). In last equation expectation 
is taken over random f-node residual degree C, random independent variable node 
redsidual degrees {Dj} and a compatibility function label R. In fact, in random 
graphical models, each f-node has an associated compatibility function randomly 
chosen among a certain collection (e.g. in spin glass models the interaction term Jjj 
is a random number ). Independence of messages coming from different subtrees 
is exploited factorizing the incoming messages joint probability distribution. Once 
sampled C and {Dj}, Af(AT)-valued function fn corresponds to BP updated rules 
(we use only factor node to variable node messages for the sake of concision) 


C Dj 

fR({' > sj})( x ) - yi i x j}) n n ( 2 - 43 ) 

{x.j} j=ls=l 

Fixed points of Density Evolution take a crucial role in Cavity Method as we will 
soon elucidate. 


2.4.2 Replica Symmetry 

Let’s turn our attention to fixed point BP equations 

i> r -n(xi) = ^2 i>r(x r ) v s ^j(xj). (2.44) 

x r\i j£r\i s£j\r 


Cavity Method in its simplest form, the Replica Symmetric (RS) Cavity Method, 
assumes that (2.44) have only one solution 1 or a symmetry related few (as in the Ising 
model in the ferromagnetic phase, we shall omit this case though). In physical terms 
this scenario corresponds to a single pure state for the system: the Gibbs measure // 
is not decomposable in a convex linear combination of independent measures (when 
this assumptions fails to be true, and an exponential number of pure states arises, 

1 That is true only for infinite graphs, for finite graphs we speak of quasi-solutions [15] or 
approximate solutions but this is unimportant in the present context. 
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we have to resort to Replica Symmetry Breaking). What we are establishing is a 
one-to-one mapping of the BP (or DE) fixed points to the pure states of the system. 
Linkage to usual thermodynamic functions is done through the Bethe free energy 
functional / Be the ({£»•-«}) defined as 


-/?/Bethe({*>r^i}) = J2 ln (X^O^) II ll i> S-+j( X j)) 
rEF %r j£r s£j\r 

+ XK 1 “ l^l)ln(En^(^))- 

v i&V Xi r€i 


(2.45) 


Free entropy gives the correct Helmotz free energy {—jdfn = f) on tree models and 
is the RS approximation to the free energy on non tree models, known to be correct 
on some simple case (e.g. Ising model on random graphs, two index assignment and 
many others). It is also known as the Bethe free entropy. It can be shown that BP 
fixed point messages can be recovered through a variational principle applied to 
Bethe free entropy. More precisely each BP fixed point is also a local maximum of <f> 
(considered as a function of | E\ messages) and vice versa [15]. 

On a factor graph ensemble we can use the (supposed to be unique) fixed point 
of Density Evolution P* and express the average Bethe free energy as 


Co Dj 


D 0 


f^fliethe 1-^ (E n n p sj(xj)) +(i - l»o) in (e n w* 

{Xj} j=l S=1 


X S = 1 


(2.46) 

Expectation are taken over random variables the random variable node and factor 
node degrees Dq and Co, the random variable node residual degrees {Dj}, the 
compatibility function node label R and messages {t> s j} and {%} independently and 
identically distributed as P*. d and c are the mean variable and factor node degrees 
respectively. 


On locally tree-like factor graphs, where loops’ length is O(lnlV), Replica Symme¬ 
try Cavity Method achieves exact values for marginals and thermodynamic functions 
as long as correlations between variables remain short-ranged, so that independence 
of incoming messages assumption holds true. Obviously Cavity Method scores poorly 
on those graphs where short loops are present and near neighbours of a variable 
i are strongly correlated even after i removal, as in the case of most models on 
finite dimensional lattices. To cope with that generalizations of Belief Propagation 
algorithm have been proposed [82] and cluster-based free energy approximation 
(of which the Bethe free energy can be considered the simplest level) have been 
studied for a long time [83]. Long range correlations are responsible for the failure of 
Replica Symmetric assumptions on locally tree-like models and Replica Symmetry 
Breaking ansatz have been developed to dispatch a cure extending the Cavity Method 
formalism. 
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2.5 Combinatorial Optimization 


2.5.1 Formulation and link with statistical physics 

Optimization has a crucial role in every human activity, because whatever our 
purposes are, being them determined by chance, feelings, instinct and reason, it’s 
our nature to speculate rationally about the best way to achieve them quickly and 
thoroughly. In mathematics and theoretical computer science a generic optimization 
problem is characterized by a feasible solution space S and an objective function 
/ : S —> M called the cost function. One is interested in finding the set of optimal 
solutions 

S* = Argmin/(s) (2.47) 

s£S 

and their cost, the optimal cost 


E* = min f(s). 


(2.48) 


Combinatorial optimization problems are a special class of optimization prob¬ 
lems, the requisite being a finite feasible solution space S. The Matching problem 
and the Assignment problem we are going to cover in the next chapters are well 
known examples of optimization combinatorial problems, among many others as the 
Travelling Salesman Problem, the Minimum Weight Spanning Tree, graph coloring, 
boolean satisfiability problems and so on (see [84]) for an introduction to the theme). 
All the combinatorial optimizations problems we just mentioned have a natural 
representation in terms of factor graphs. 

Link between combinatorial optimization and statistical physics is made through 
the partition function 

Z e _/3/(s) (2.49) 

s£S 

and the solution to the problem is recovered in the limit (5 f °o. cost function / is thus 
associated to the total energy of a given configuration. To obtain a sensible statistical 
physic model the cost function has to be properly scaled (an operation that leaves 
S* unaltered) in the size of the problem N (often the number of variables involved) 
so that thermodynamic quantities are linear in N. Moreover the large N limit has to 
be taken, so that model (2.49) is apt only to study the asymptotic behaviour of an 
optimization problem. That’s not a hindering limitation however, because threshold 
characterizing interesting transitions (e.g. the SAT-UNSAT transition in the random 
K-SAT problem) can be made sharp only for N f oo and many asymptotic properties 
tends to be acquired very fast as N grows. 

Very often, at least from a theoretical point of view, one is interested in elucidating 
the average behaviour of random instances of some optimization problems. 

It turns out that techniques developed by physicists in the contest of spin glass 
theory, and the Cavity Method in particular, are well-suited to cope with these 
problems. The seminal paper in the field was published in 1985 by Parisi and 
Mezard [18]. They used the Replica Trick in the Replica Symmetric approximation 
to compute the asymptotic optimal total cost of the random link assignment problem. 
After their work many other appeared in the successive years, addressing completely 
connected or dense graphical model through the Replica Trick [19,85], which could be 
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used in its original form and allowed for Replica Symmetry Breaking. At that time, 
on sparse graphical models only the RS ansatz could be applied using the Replica 
Trick [86]. The next leap forward was made in 2001 thanks again to Parisi and 
Mezard, who showed how to implement the first step of replica symmetry breaking 
on sparse graphical models through the Cavity Method [14]. The algorithmic version 
of the 1RSB cavity method was then proposed in Ref. [20]. 

Development in this field through the 2000s have been impressive. The connection 
between the Bethe approximation in physics and the Belief Propagation algorithm 
from computer science was recognized [87], and a class of heuristic algorithms based 
on Kikuchi’s cluster-variation method [83] was proposed [82]. Random constraint 
satisfaction problems, such as K-SAT, where characterized in terms of the geometric 
structure of the space of solutions, a collective effort which involved many scholars 
for two decades, summarized in Ref. [22]. For example, in large instances of the 
random 4-SAT problem, calling a the parameter controlling the density of clauses 
that have to be satisfied, there exist three values < a c < a s such that : for 
a < ad almost all solutions belong to unique cluster, that is any two of them are 
connected by a path of solution involving a small rearrangement of the configuration 
at each step; at a = a<i there is the clustering (also said dynamical) transition, and 
for otd < oc < a c solutions are organized in an exponential (in N) number of clusters; 
at a = a c the system undergoes a thermodynamic transition, called the static or 
the condensation transition; for a c < a < a s a finite number of clusters carries the 
whole Gibbs measure; finally, above a s , the satisfiability threshold, the problem 
admits no solutions at all [15]. 

In this thesis we will focus on a problem with a simple, replica symmetric 
structure, the Matching problem, that we present in the next paragraph. 


2.5.2 The Matching Problem 


The matching problem is a combinatorial optimization problem that has drawn 
the attention of both the computer science [84,88-92] and the statistical physics 
[18,19,59,62,93-97] communities for many decades. Among its pletora of applications, 
we mention computer vision [98], control theory [99,100] and pattern matching [101]. 
Variants of the matching problem are the multi-index matching problem [60] and 
the set packing problem [6] 

Even in its most general formulation, the problem belongs to the P computational 
complexity class, and many famous algorithms have been developed to solve it 
efficiently [88,89,91]. 

For a given N x N cost matrix Wij, i,j = 1,..., N, Wij = Wji , the minimum 
matching problem is formulated as the following integer programming problem: 
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minimize E[n ; w] = Y / WijUij 

i<j 

SUBJECT TO riij £ {0, 1} V'i, j 

Tlii = 0 Vi (2.50) 

n%j — uVi, j 

= 1 Vi 

j 

More generally and from a graph theoretic perspective, for an arbitrary graph 
G = (V, E) a matching M is a subset of the nodes, MCE, such that no node in 
V has two or more edges in M. Two nodes i and j are matched if (i, j) £ M , and 
in that case we call (i,j) a match. A perfect matching is a matching where each 
node is matched. The size of a matching is its cardinality. A maximum matching 
is matching such that no other matching has greater size. Notice that maximum 
matchings generally are not unique. If we associate a real number Wij, that we call 
cost or weight, we are considering the weighted matchings. Since in this thesis we 
address only weighted matchings we call them matchings as well. A minimum weight 
maximum matching is a matching that solves the following problem, that we will 
generally call the matching problem: 

minimize E[n ; w] = ^ WijUij 

SUBJECT TO ^2 n ij MAXIMIZED 

(iJ)eE (2.51) 

n^ £ {0,1} V('i, j) £ E 

Y, <1 Vi £ V 

j£di 

Matching that satisfy this property are also called optimal matchings. The function 
E[n\w] is the cost function and its mimum value E*[w\ is the optimal (total) cost. 
We see that this problem reduces to the formulation 2.50 when the underlying graph 
is the complete graph. When G is taken as a complete bipartite graph, we will call 
problem 2.51 an assignement problem or a bipartite matching problem. 

In this thesis we deal with random instances of the matching problem. One 
kind of randomness that we do not examine is the one in the underlying graph G. 
Matching on random graphs, in fact, both in its weighted and unweighted versions, 
has been investigated in numerous papers [61,90,102,103]. 

Here we investigate fully-connected models where the randomness is encoded 
in the cost matrix {w^}. The archetypal example of such problem is the random 
link, where the matrix elemens are independent and identically distributed. The 
random link problem was investigated, using the replica method, by Parisi and 
Mezard [18]. They obtained, for exponentially distributed costs, the celebrated 
result 


lim E m E* [m] 

TV—>-+oo 



(2.52) 
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later proved by Aldous [104] and successively, using different techniques, by Linusson 
and Wastlund [105]. 

A much more difficult problem is the Euclidean matching problem. The cost 
matrix here is induce by the distances among N points distributed uniformly in 
a box in M rf , Wij = ||xj — Xj||. Therefore the matrix element are highly correlated 
and analytical treatment is very difficult. The problem was introduced in Ref. [58] 
and studied with the replica method, although a crude approximation was made, 
considering only cost correlations among triple of points (triangles) and factorizing all 
the others. In Chapter 7 we show how to improve upon their approximations taking 
into account correlations in polygons of arbitrary lengths. In Chapter 6 instead we 
use a completely different approach, based on continuum approximation, to analyse 
the Eulidean bipartite matching problem, where density fluctuations among the two 
point sets lead to non-trivial scaling behaviour for the average optimal cost. 

Noticeably, on complete graphs, although the BP algorithm does not converge, it 
gives the exact optimal configuration and total cost after a certain problem-dependent 
iteration step [81,106]. Also the Cavity method predictions for diluted models have 
rigorously proved on locally tree-like structures [103]. . 

For numerical analysis we make use of the solver implemented in the Lemon 
Graph Library [107]. It is based on Edmond’s blossom algorithm [91], which has 
©(]C|]-£/] In |V|) computational time complexity. This would make for a @(IV 3 ln N) 
complexity for the fully connected graphs we deal in this thesis. Since edges 
participating in optimal matchings belong to the 0(1/N) fraction with the lowest 
weights [108], in numerical experiments we prune from the graphs the edges with 
weights above a certain cut-off value 7 . Obviously 7 has to be chosen high enough 
to not interfere with the optimal matching. The pruning procedure transforms the 
graph in a diluted random graph, therefore the algorithmic complexity is reduced to 
©(A 2 In N). 

2.5.3 The Minimum Cut Algorithm 

As an example of application of techniques from combinatorial optimization to 
disordered systems, in this paragraph we will show the equivalence between the 
problem of finding the ground state configuration in a RFIM and the minimum cut 
problem, an combinatorial optimization problem belonging to the P computational 
complexity class, also known as min-cut problem). To our knowledge this equivalence 
is stated for the first time in Ref. [109]. Consider an instance of the RFIM on graph 
G = (V,E). The Hamiltonian is given by 

H[a\ = - Y ~ H h i (2.53) 

(i,j)£E i£V 

with Jij > 0. We want to find the spins configuration a* that minimizes the energy 
of the system. We notice that a spin configuration a is specified by a partitioning 
of V in two sets, V + and V~ , V + U V~ = V , such that Si = 1 for i £ V + and 
Si = —1 for i £ V~. The energy of a configuration is determined by the "unsatisfied" 
bonds and fields. In fact, if we define the two sets H + = {i £ V : hi > 0} and 
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H = {i £ V : hi < 0}, we have 

H[V+,V~] = E ref + 2J ij+ E 2 N + E 2 N> ( 2 - 54 ) 

iev+ ieV+nH- ieV~nH+ 

j£V~ 

where for convenience we set Jij = 0 if (i,j) 0 E. The reference energy E re f is 
defined by 

E re f = ~ E _ E 141 (2.55) 

(i,j)£E i€.V 

In order to transpose the energy minimization problem in a minimum cut problem, 
we construct an auxiliary oriented graph G = (V,A). The node set of the new 
graph is the old one plus two additional nodes representing the positive and negative 
field respectively, V = V U {+,—}. The arc set A is the union of three sets, 
A = E U E + U E~. E contains two arcs for each edge in E, E = {(i —>■ j) : 
( i,j ) £ E}. The other two sets are defined as E + = {(+ —> i) : i £ H + } and 
E~ = {(?' —>■—):?'£ H~}. We associate a weight Jij > 0 to each arc (i j) £ A 
according to 

( Jij (i :y j) £ E , 

Jij = lhj (i -)■ j) £ E + , (2.56) 

{-hi (i^j)eE~. 

For convenience we also set J q/J = 0 if (i —$■ j) 0 A. It is now easy to see that we 
can rewrite each configuration’s energy in terms of the non-asymmetric matrix J, 
and that minimization of the energy given in Eqs. (2.53) and (2.54) is equivalent to 
finding 

min y' Jij (2-57) 

V+,V- 

i£V+ 

jev- 

Minimization is over all the partition of V in two sets, V + and V ~, such that 
+ £ V + and — £ V~. This the exact definition of the minimum cut problem for G 
with source + and sink —. Its connection to the ground state of the RFIM is thus 
established. 

Therefore, in order to find the ground state configuration of the RFIM, we can 
go trough the construction of the auxiliary graph depicted above and then use one 
of the many algorithms available to solve the corresponding minimum cut problem. 
In particular the max-flow min-cut theorem , establishes the equivalence through 
duality of the minimum cut problem with another celebrated optimization problem 
on graphs, the maximum flow problem [84]. Therefore many algorithm used to 
solve for the min-cut exploit this connection with the max-flow. In this thesis we 
make use of the solver implemented in the Lemon Graph Library [107] based on 
a push-relabel maximum flow algorithm [110]. The computational complexity of 
this algorithm is 0(|I7| 2 \/[FJ[). For finite connectivity systems the computational 
complexity is therefore Q(N 2 ' 5 ). Average computational complexity is significantly 
inferior, as discussed in Figure 2.2. 

Unfortunately minimum cut algorithms work only for positive weights Jij, there¬ 
fore they cannot be us find the ground state of Ising spin glasses. Energy minimization 
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Fig. 2.2. Timing of the push-relabel minimum cut / maximum flow algorithm implemented 
in the Lemon graph library. Simulations were performed on a Core i5 2500k processor. 
(Left) RFIM on random regular graphs with conectivity z = 4. (Right) RFIM on a 
cubic lattice in dimension d = 3. Averages are taken over 10000 samples. The error 
bar is the standard deviation of the population. Quite interestingly the computational 
time remains constant in the whole paramagnetic phase up to the transition point and 
decreases only in the ferromagnetic phase. Average computational complexity varies 
approximately between Q(N 15 ) and Q(N 2 ) in the range considered. 


in spin glass can be stated as a maximum cut problem, and it belongs to the NP 
computational complexity class [111]. Best exact solver for spin glasses are usually 
based on brunch-and-bound approaches [111]. 

On the other hand many heuristic solver have been proposed to find spin glass 
ground states [111,112], Noticeably for the present discussion, one of these heuristics, 
the Cluster-Exact Approximation (CEA) , is a zero temperature Markov Chain 
Monte Carlo algorithm where the standard single spin flip is replaced with the exact 
minimization of the energy on a unfrustrated subgraph of the original graph [113]. 
In fact any unfrustrated Ising system can be gauge transformed in a ferromagnetic 
system, therefore the min-cut algorithm can be (locally) applied. Also combination 
of genetic algorithms [114] and CEA have been recently proposed and showed to be 
highly effective [115]. 


2.6 Finite size corrections 

In finite dimensional systems with periodic boundary conditions one would expect 
exponentially decaying finite size corrections, due to arguments somewhat related 
to the Euler-McLaurin formula. The system in fact feels its finiteness, as far as 
observables are concerned, only through diagrams involving rewiring around the torus. 
This implies, for non-critical systems, an additive correction which is exponentially 
decaying in the length L of the lattice, or some power of it. Divergence from this 
standard behaviour is an interesting phenomena and points towards criticality. The 
Euclidean monopartite and bipartite matching problems belong to this class, as we 
will investigate in Chapters 6 and 7. 

Finite size corrections have been computed in the SK model, on the Almeda- 
Thouless line, by Parisi, Ritort and Slanina [116,117]. Their approach is based on a 
replicated field theory. Due to the divergence of all the terms in the diagrammatic 
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expansion around the saddle point, at the critical point and in the whole spin glass 

phase, they have to resum an infinite class of diagrams. They found a 0(- 

2 

correction to the free energy and a 0(N~ 3 ) to the energy. There is some evidence 

2 

from numerical simulation of a 0(N~3 ) correction for both the energy and the free 
energy in the spin glass phase [118]. Understanding finite size corrections in finite 
dimensional spin glasses, a much difficult analytical and numerical (due to long 
equilibrating times) task, is of fundamental importance to asses the validity of any 
theory competing for the explanation of the glass transition [75,119]. 

Regarding the deep spin glass phase, the zero temperature point has a special 
place. The search of ground state of spin glasses, a minimum cut problem with 
positive and negatives capacities, is a computationally hard problem. Nonetheless 
many successful heuristic algorithms, such as Cluster Exact Approximation (CEA) 
[113], Hierarchical Bayesan Optimization Algorithm (hBOA) [120,121] and Extremal 
Optimization (EO) [122], have been developed to deal with large instances of the 
problem. In particular, using EO, the finite scaling behaviour of zero temperature 
mean field and finite dimensional spin glasses was deeply investigated in Refs. 
[123-125]. 

Finite size corrections in the glassy phase are outside the scope of this thesis 
though. In Chapter 4 we will discuss topology related corrections, since in diluted 
random graphs simple combinatorial arguments give the scaling of the average 
number of loopy subgraphs as powers of 1/N. In Chapter 5 instead, 0(l/\/~N) finite 
size correction in the RFIM are induced by fluctuations of the total random external 
field. Lastly, in the Euclidean Assignment problem investigate in Chapter 6, an 
anomalous subleading scaling for the average cost is also due to fluctuations in the 
disorder, namely to the differences in local densities among the two sets of points . 
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Chapter 3 

The Replicated Transfer Matrix 


3.1 Introduction 

The study of one-dimensional Ising chain with random bonds and/or fields has a 
long tradition in the context of disordered systems. Over the years this field has 
experienced an interesting change in perspective. Earlier studies were essentially 
motivated by the need to obtain solvable version of three-dimensional models [126— 
129] and this line of research culminated with the introduction of specific random 
Hamiltonians that are actually solvable analytically [130-133]. In the last twenty 
years dynamical approaches have also been considered as alternatives to equilibrium 
approaches [134-137] while developments in the context of static studies [138,139] 
have been mainly motivated by the connection between one dimensional systems 
and models defined on sparse random graphs. Random graphs in turn have many 
important applications in the context of computer science, artificial intelligence and 
information theory [13,15]. In this broader context one is more interested in having 
a general formalism that can be applied to any given distribution of the quenched 
Hamiltonians at the price of obtaining the result through numerical solution of 
implicit equations. 

In the general case one would like to study an Ising chain, either open or closed, 
of arbitrary length L were the fields and couplings are i.i.d. random variables. 
Quantities of interest include the free energy but also all sort of averaged correlation 
functions. Indeed, at variance with pure systems, correlations can be averaged 
in two different ways: over thermal noise (conventionally referred as connected 
correlations ) and over the quenched Hamiltonians (disconnected correlations). This 
difference is important both at the theoretical and the practical level. Indeed 
disconnected correlations happen to be much larger in random field systems (but 
not in Spin-Glasses) and lead to a very complex phenomenology, e.g. the increase 
in the critical dimension from D = 4 of the pure ferromagnet to D = 6 [80]. In this 
chapter we show how to complete this program by means of the replica method, 
more precisely by means of the replicated transfer matrix (RTM) approach. As long 
as the sources of disorder are independently distributed, one can express the integer 
moments of the partition function through traces of powers of the 2 n x 2 n transfer 
matrix of a system of n replicated spins. Then, as usual with replica calculations, 
the analytic continuation to n = 0 is performed. We will derive expressions for 
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the aforementioned quantities in terms of the solutions of integral equations that 
can be solved for instance through population dynamics algorithms. In order to 
do so we build on the crucial contribution of Monasson and Weigt [138], who first 
characterized the spectral properties of the RTM. The motivation is not only to have 
a compilation of useful formulas but also to present some non-trivial features of their 
derivation. The most important is connected with the fact that in the limit n —> 0 
two families of eigenvalues (corresponding to the Longitudinal and Anomalous sectors 
in the Spin-Glass jargon) become degenerate. From the theoretical perspective, this 
determines an anomalous behaviour of the disconnected correlation functions and 
of corrections to the free energy of closed chains. On a practical side this implies 
that one has to determine not only the eigenvalues and eigenvectors of the integral 
equations at n = 0 limit but also their first 0(n ) correction. 

While the replica method is at present the only way to derive expressions for all 
quantities of interest in a compact form, its well-known drawback is the assumption 
that one can make the analytical continuation n —> 0 of expressions whose derivation 
makes sense only for positive integer n. One is therefore interested in deriving the 
same expressions in a more direct way. Unfortunately there are no general results or 
strategies on how to do this and one has to proceed case by case. We will present 
a direct probabilistic derivation of many of the expressions obtained through the 
replica method. A particularly non-trivial result is the derivation of the formula for 
disconnected correlation functions that has been long sought for. Such a derivation is 
based on the fact that a direct physical meaning can be attributed to the continuation 
of replica expressions to real n, at variance with other classic analytical continuation 
tricks ( e.g. dimensional continuation in field theory). Therefore one can first derive 
rigorously an expression at any real n and then safely take the limit n —> 0. The 
only replica expression whose derivation is left as an open problem is the free energy 
of closed chains. We recall that closed chains are rather important objects that 
appears in perturbative computations developed around the tree approximation [2], 

We conclude this introduction by briefly discussing the connection between our 
results and the extensive literature on disordered Ising chains. As we said already 
earlier studies, appeared in the context of the random field Ising model (RFIM), were 
motivated essentially by the possibility of obtaining exact solutions when dealing 
with one-dimensional models. It was immediately recognized [126-128] that the 
free energy of an infinite chain can be expressed in terms of an iterative equation 
which corresponds to the Longitudinal sector in the terminology of RTM. Exact 
results can be obtained at zero temperature, where the equation can be solved 
explicitly [127] or by enumeration in the special case in which the random fields 
are either zero or infinity [129]. Finally it was discovered that some models with 
specific distributions of the disorder can be solved analytically [130-133]. Much 
effort has been put in the study of the iterative equation relevant to the free energy 
of the infinite chain, starting from the observation that when the random fields 
and couplings take a discrete number of values ( e.g. H = ±1) the solutions of 
the equations may display a multi-fractal structure [140-143]. The approaches 
taken to characterize the correlation functions have been less successful. Connected 
correlations where computed exactly for the aforementioned solvable models but the 
disconnected correlations resisted all efforts [131] to capture their expected peculiar 
features (the double pole) [80] up to this work. Later on correlations functions were 
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Fig. 3.1. Pictorial representation of the matrix T n (left), its powers ( center ) and the 
matrix Tn' 1 (right). 


also studied in a more general framework at zero temperature [144], but again non 
considered the disconnected correlations. The results of [131] are system-specific and 
not based on iterative methods, only recently [145-147] it has been recognized that 
general iterative expressions for connected correlations can be obtained by means of 
cavity arguments like those we will present in the following. 

The chapter is organized as follows: in Section 3.2 we define the model we are 
considering and expose the main results of this chapter; in Section 3.3 we develop all 
the spectral formalism of the RTM and we apply it in Section 3.4 to the computation 
of free energies and correlation functions. Most of the results obtained with the 
RTM are then rederived with a purely probabilistic approach in Section 3.5. 


3.2 Definitions and main results 


In this chapter we consider one-dimensional Ising spin system with i.i.d. random 
fields and couplings , e.g. an isolated chain or a chain embedded in a locally tree-like 
graph, therefore described by the product of uncorrelated 2x2 random transfer 
matrices Mj defined by 

Mi(a i+ i, (7j) = e P J i°i+i°i+ h i'n . (3.1) 


The partition function of a closed chain of length £ is then a random variable given 

by 

e-i 

Z tc = Tr II M t - (3.2) 

i=0 

A powerful technique to compute the statistical properties of this kind of objects is 
the well known replica method [13]. As we shall see, as long as the system stays 
in a replica symmetric phase, its statistical properties are encoded in the (replica 
symmetric) replicated transfer matrix T n , the 2 n x 2 n matrix defined by 


T n (a,r) 


E Jh e ^£:=i^“+/^:= 


(3.3) 


Here and in the following we denote with o the vector (cr 1 ,..., a n ), with the n 
replicated spins <r a taking values in Zi = {—1,1}. A similar definition holds for r. 
As usual in the replica method [13] we shall work at integer value of n and perform 
the analytic continuation for n X 0 at the end of the computations. We shall assume 
in the following that the field h is an arbitrary distributed external random held, if 
we are considering an isolated chain, or, if we are considering a chain embedded in a 
locally tree-like graph, to be a random cavity held conditioned to act on a spin that 
is already connected to two other spins (its neighbours on the chain). See Figure 3.1 
for a representation of T n and its powers T^. 
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A first spectral analysis of T n was conducted by Weigt and Monasson [138]. 
Following their lead we take advantage of the replica index permutation symmetry 
of T n to choose an appropriate bases to express its right eigenvectors. There are 
n + 1 non-equivalent irreducible representation of the permutation group, which 
can be glued together to form the sectors D- q \ q = 0,1,..partitioning Zf 11 - 
In the following, with some abuse of notation, we will denote with the set of 
eigenvalues of T n with eigenvector in that sector. The eigenvectors of T n in the 
sector can be parametrized by functions gq{u) that, in the limit n 0, satisfy 
the eigenvalue equation 

/ /du\ q 

d v gg(v) S(u-u(J,v + h)) ( — ) , (3.4) 

where u(J, h) = ^ atanh (tanh (/3J) tanh(/3/i)) is the cavity iteration rule. 

In this chapter we extend the analysis of the spectral properties of T n to achieve 
a complete description of the n j, 0 limit, derive exact expressions for correlation 
functions and free energies of chains. Since T n is the product of two non-singular 
symmetric matrices, it possess a complete orthonormal (in the left-right sense) basis 
of left and right eigenvectors with real eigenvalue. The left eigenvector corresponding 
to a certain right i/i/i is simply 'tpR(cr) = P/ 1 .(o')V ; i?( cr )- Therefore the 

spectral decomposition of T n into the subspaces is given by 

T n{°, t) = J2 J2 A Pq{<r)p h {T)p*{T) ^ Qa 1 ...a q M-b q ^ • • • O aq T bl • • • T bq . 

9=0 AgflW ai<—<a q 

b\<---<b q 

(3.5) 

Here we have denoted with Pg(r) the replica symmetric part of the eigenvector 
in the sectorwith eigenvalue A. The second sum is over all the eigenvalues 
of T n in the sector D^ q \ given in the n | 0 limit by the solutions of Eq. (3.4). 
The coefficients Q ai ...a q ;bi -b q have simple algebraic expressions in each sector (see 
Eqs. (3.27) and (3.28)) and are invariant under permutations of any of their two 
sets of indices. While a different left-right decomposition of T n has already been 
attempted [139], an unfortunate choice in the parametrization of the eigenvectors in 
terms of function of two variables led to an unmanageable formalism. Thanks to the 
spectral representation (3.5) we can easily take the powers of T n and contract the 
matrix with the quantities we want to average. In Section 3.3 we derive Eqs. (3.4) 
and (3.5), and discuss the non-trivial aspects of the small n limit. 

One of the applications of the spectral formalism is the computation of the 
average free energy of open and closed chains, as exposed in Section 3.4.1. Recently 
it has been shown [2] that the first finite size correction to thermodynamic free 
energy of systems on diluted graphs can be expressed as a linear combination of 
the free energies of closed and open chains. It has also been argued [148] [2] that a 
perturbative expansion around the Bethe approximation towards finite dimensional 
lattices, shall account for the presence of loops (closed chains) and will contain the 
free energies and the correlation function of one-dimensional objects, motivating the 
importance of exact and easily approximate expressions for their free energies. 
Taking the trace of and performing the n j, 0 limit one obtains the average 
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free energy of a closed chain of size t. 

OO 

- Pfe = + E A a £A^ + E4 E a '- ( 3 -6) 

xgdW 9=1 Ae-D(«) 

The non-trivial features of this expression is the presence of a term 0(£ A^ _1 ). This is 
typically not present in a ordinary eigenvalue decomposition that contains only O(X^). 
Its presence is due to the n —>■ 0 limit combined with the fact that the longitudinal 
and anomalous eigenvalues become degenerate. As we said in the introduction this 
is a phenomenon that has dramatic physical consequences in the RFIM context [80]. 

The terms A a , due to the degeneracy between the eigenvalues of the sectors 
and at n = 0, are expressed in Eq. (3.48). The coefficients d q are the analytic 
continuation of the degeneracies of the eigenvalues, and are given in Eq. (3.41). We 
note that the correction to the intensive free energy /o (expressed in Eq. (3.43)) is 
given by a linear combination of exponential and l times exponential terms. The 
decaying part of is dominated by the largest eigenvalue among the various sectors. 

In the computation of the free energy of an open chain, we allow for the incoming 
fields at the extremities of the chain to be distributed differently from the fields h 
acting on the internal spins, and denote them by h. This is in fact what happens in 
general when considering an open chain embedded in a sparse graph. The expression 
we derived for the average free energy of an open chain of length £ is 

— /3fg = — £/3fo +1 % J du P(u) 2 log cosh (jd(u + h)^j 

— E/j J dudv P(u)P(v) log cosh (/3(u + v + h)) ( 3 . 7 ) 

+ log 2 + E a A,0 ^ r 

AeD (1 ) 

where P(u ) is the distribution of cavity messages along the chain and the coefficients 
a \ } o are related to the left eigenvectors of the sector and given in Eq. (3.59). 

Another result we will present is the expression of the connected correlation 
functions of two spin at distance £, in a form that is both analytically exact and 
easy to approximate numerically with high precision. In Section 3.4.2 we derive the 
formula 

{a 0 a e ) q c = E a \q Af » ( 3 - 8 ) 

A eD(i) 

where a A ,fc can be computed through the eigenfunction g* using Eq. (3.64). We 
indicate with • the average over all kinds of disorder in the model considered. For 
Ising model on sparse random graphs with mean residual degree z, the susceptibility 
Xq = J2i<j ~k^( cr i a 'j)i diverges when the greatest eigenvalue of reaches the value 
1/z. Therefore the sectors D ^ and D^ are the relevant ones to the ferromagnetic 
and the spin-glass transitions respectively (see Figures 3.2 and 3.3). 

The computation of the thermally disconnected correlation function, (cro) (ct^) — 
(<To) (ere), particularly relevant to the RFIM [73], requires a careful treatment of the 
analytic continuation to n = 0. The final expression we obtained, Eq. (3.71), is 
not a linear combination of terms involving only one eigenvalue, as in the previous 
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formulas. The leading term for large t is easily extracted though: let Ai be the 
greatest eigenvalue of the sector then 

- ( 00 ) We) = A Al + 0(Ai) for £ —>■ + 00 , (3.9) 

with Av and a\, 1 given in Eq. (3.48) and Eq. (3.64) respectively. Therefore, on 
one-dimensional chains and sparse graphs, the susceptibility corresponding to the 
thermally disconnected correlation function present the characteristic double pole 
behaviour near the transition point, whose prefactor can also be computed by Eq. 
(3-9). 

The expressions we found for free energies of chains, Eqs. (3.6) and (3.7), and 
the correlation function Eqs. (3.8) and (3.9), are exact for every value of the length 
t of the chain but involve the computation of infinitely many terms. Fortunately it 
turns out from our numerical simulations that the spectrum of the integral operator 
in Eq. (3.4) is discrete and the eigenvalues are well spaced. Therefore considering 
only the first few highest eigenvalues one obtains very good approximations already 
at small values of £. They can be computed numerically, discretizing the kernel of 
the integral operator of Eq. (3.4) and directly computing the eigenvalues of the 
associated matrix. Moreover the leading eigenvector and eigenvalue of each sector 
can be efficiently selected with multiple applications of the discretized operator on 
an arbitrarily chosen vector (as it was done to obtain Figures 3.2 and 3.3). 

All the results we obtained using the replicated partition function formalism, 
with the noticeable exception of the formula for the average free energies of closed 
chains Eq. (3.6), can be recovered using a purely probabilistic approach in the same 
spirit of the usual cavity method [13] [15]. 

In Section 3.5.1 we devise two alternative probabilistic derivation for the average 
free energies of open chains . The first is based on a recursive equation involving 
the moments of the partition function, which leads to an expression for the moment 
of the random partition function Zg of an asymmetric open chain in terms of the 
left and right eigenvector of an integral operator we also encountered in the RTM 
formalism: 

Zg(u\x) = ^2 A^(n) <?o i u i n ) $o ( x 'i n ) [2cosh(/3x)] n . (3.10) 

A efl(°) 

Here n is not related to the number of replicas, since replicas are not present in 
this approach, but is an arbitrarily chosen real positive number. The other method 
presented in Section 3.5.1 the iteration of the average free energy itself during the 
construction of the chain, which requires to keep track of the message of ug the cavity 
message propagating through a chain at distance l from one of the extremities, at 
each iteration. The two approaches are deeply related and obviously lead to the 
same result. 

Crucial to the probabilistic computation of the connected correlation functions, 
ah has been noted recently [146] is the random variable Xg defined by Xg = 
wheveHo held acting on the same extremity. It turns out that the connected 
correlation function of Eq. (3.8) is encoded in the g-the moments of the joint law of 
ug and Xg at fixed ug. This object, the function 

GW(u) = f dX Pg(u, X) X q , 


(3.11) 
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obeys a recursion rule, Eq. (3.87), containing the integral operator of Eq. (3.4). 
Expressing G^\u) in the basis of the eigenvalues of leads then straightforwardly 
to the expression (3.8) we obtained using replicas. Moreover in Section 3.5.2 a more 
general result is presented in Eq. (3.90). 

The thermally disconnected correlation function (Jo cr e)c is computed in Section 
3.5.3, using some results we obtained for the connected correlation function and for 
the moments of the partition function of an open chain, thanks to the relation 

~dHQ~dW^'° = U ( a ° a ^ c ° + 71,2 <*o>to> Zlo- (3-12) 

An alternative approach, technically more difficult, outlined in Section 3.5.3 in¬ 
volves the resolution of an iterative equation for the function R^\u) = 5(u — ug){c tq)^\ 
which takes into account the shift in the magnetization of the (initial) spin at the 
other side of the chain with respect to the spin where a new spin is attached to 
increase the length of the chain. 

In the following Sections we fill-in all the technical details associated to the 
previous claims. 


3.3 Spectral decomposition 

We present an in-depth treatment of the spectral theory of the replica symmetric 
RTM. In Section 3.3.1 we discuss the spectral decomposition of the matrix for 
integer values of the number of replicas n. We introduce in Section 3.3.2 an integral 
representations of the eigenvectors, in order to discuss the main features of the 
analytic continuation to small values of n in Section 3.3.3. In Section 3.3.4 we discuss 
some technicalities related to a peculiar aspect of the n | 0 limit, the degeneracy 
between the Longitudinal and the Anomalous sectors. 


3.3.1 The Permutation Group 

The 2 n x 2 n matrix T n defined by Eq. (3.3) is invariant under the action of the group 
of permutations among the replicated spins: for each permutation n acting on the n 
spin, we have the equivalence T n (n(a), 7r(r)) = T n (a, r). This symmetry allows us to 
block-diagonalize T n according to the irreducible representations of the permutation 
group. This idea has been first introduced by Weigt and Monasson [138] in order to 
compute the eigenvalue spectrum of T n . 

For the sake of completeness we now review Weigt and Monasson’s method, then 
we extend it further, in order to achieve the decomposition of the transfer matrix 
in terms of left and right eigenvectors. The replicated space is Zf n - Let’s call A m , 
with m = 0, ...,n, the subspace of configurations having exactly m spins up. These 
subspaces are clearly invariant under any permutation of the replicas, therefore we 
can consider the representation of the permutation group in the n + 1 subspaces A m 
and look for the irreducible ones. The complete decomposition of A m into irreducible 
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subspaces D^ m,q ^ has been done by Wigner [149]. It reads: 

A 0 = Z#’ 0) , 

Ai = D (1 ’ 0) ©Z) (lll) , 

A n = 0 _ . . 0 £)( m > min (m,n-m)) 

A n _i = D ^- 1 ’°) © D^- 1 ’ 1 ) , 

A n = L>( n ’°) . 


(3.13) 


Representations D^ m,q \ at fixed q, are isomorphic and have dimension 


dq 




Q = 0,..., [n/2j , 


(3.14) 


where [xj is the smallest integer part of x. Notice that by definition do = 0. As we 
have (n+1— 2q) subspaces D^ m,q \ the ^-sector of our matrix T n will contain (n+1 — 2q) 
eigenvalues with degeneracy d q . One can check that J2 q =o d q (n+ 1 — 2 q) = 2 n . 

A vector of the space can he constructed using Young tableaux [145], and 

has the form 


\m,q) = (]+)]-) - \-)\+)) q SYM(\+) m - q \-) n - m - q ) , (3.15) 

where the operation SYM means a complete symmetrization with respect to the 
n — 2q last entries (the first 2 q entries are, instead, anti-symmetrized). A basis 
of the subspace D^ m,q ^ can be constructed by applying all the transformations of 
the permutation group to the vector \rn, q) in Eq. (3.15) and choosing a maximal 
linearly independent subset. 

We look for the eigenvectors of T n in the subspaces 


n—q 

D® = 0 D (m ’ q) 

m—q 


<7 = 0 ,..., 


(3.16) 


of dimension d q (n + 1 — 2 q). Since T n has no symmetries beside the replicas 
permutation one, it has n+l — 2q different eigenvalues in D^ q \ each with multiplicity 
d q . In the following we will refer to the subspaces as to sectors. Moreover, 

with some abuse of notation, we shall use the symbol for the set of eigenvalues 

corresponding to eigenvectors in that sector. 

Of particular relevance are the sectors D^°\ D ^ and D g 2 "* since they are as¬ 
sociated to the Longitudinal, Anomalous and Replicon modes respectively from 
mean-field spin-glass theory [150], as we will later show when discussing correlation 
functions in Section 3.4.2. 

By Eqs. (3.15) and (3.16) it is possible to factorize the replica symmetric part in 
the eigenvectors 'ipq(o') of the transfer matrix in the sector D^ q \ that is we can write 

'<A0) = Pq fe C ai...a q <J ai ■ ■ • <J aq , 

\ a ) a\<-"<a q 


(3.17) 
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where the replica symmetric part p£ of the eigenvectors is the one relevant to the 
computation of the eigenvalues. By last equation the eigenvectors of the sector 
£>(°) are completely replica symmetric. The coefficients C ai ... a are invariant for any 
permutation of the indices and are equal to zero if any two of the indices are equal. 
Moreover they have to satisfy the constraint 

n 

E C ai ... aq = 0, (3.18) 

a\ = l 

which is a necessary and sufficient condition for any vector of the form of Eq. (3.17) 
to belong to the subspace D^ q \ Any set of d q linearly independent coefficient vectors 
C can be chosen as an appropriate basis for the subspace. It is easy to prove that 
the product of two non-singular symmetric matrices possess a complete orthonormal 
(in the left-right sense) basis of left and right eigenvectors with real eigenvalues, and 
this is indeed case for T n . In fact if we define, with a little abuse of notation, the 
vector 

p h (a) = E h e^a- a , (3.19) 

than T n (a,r) = Yl a ' e /3Jaa ' x 5 a ' T Ph{T). Moreover the left eigenvector i pi corre¬ 
sponding to a certain right iPr((t\ A, k) is simply given by 

A, k) = p h (cr) iPr(o"-i A, k) , (3.20) 

where k denotes one choice of the coefficients C ai ...a q among the d q possible. Imposing 
the orthonormality condition 

E iM 0- ; A, k) r{<t ; A', k') = 5\y S kk f , (3.21) 

a 

with the sum ranging over all the 2 n configuration of the replicated spin, and after 
successive application of Eq. (3.18), we obtain 

^2p^a)p h (a)p^(a) J] (1 - a 2o “ V 2a ) = <5 A a' (3.22) 

cr a= 1 

along with 

E = Sk«. (3-23) 

a\<--<a q 

We are now able to write down the transfer matrix in the spectral form 

LfJ 

T n {a, t) = E T n,q(v, r) (3.24) 

9=0 

where T n q is the restriction of T n to the subspace D^ q \ defined by 
Tn,q(v, t) = E A P q {c)Phir) p q (r) E Qa 1 ...a q -,b 1 ...b q ^ ■ • • T bq . 

XeDM ai<—<a q 

bl<---<b q 


(3.25) 
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The coefficients Q appearing in last expression are invariant for any permutation 
of the set of indices a or b, therefore they depended only on the number of equal 
indexes in the sets {ai,..., a q } and { 61 ,..., b q }. They are defined by 

dq 

Qa 1 ...a qM ...b q = E C L.aA. bq , (3-26) 

k=l 

and their (q + 1) different values can be computed applying recursively Eqs. 3.18 
and 3.23. If we denote Qp 1 ' the coefficient in the sector with p pairs of different 
indexes, for the first sectors we have 



qS 1} = 

l 


(3.27) 

n 

n 


p( 2 ) _ n ~ 3 

Q { ? = 

of 

^ O 

o/n(2) 

of = Q \ 

(3.28) 


3.3.2 Integral representations 

In order to perform the limit n 0 it is convenient to find a suitable parametrization 
for the eigenvectors of the form (3.17). For the replica symmetric part of the 
eigenvectors ip q , see Eq. (3.17), we employ the standard parametrization 



e^Ea^ 

[2 cosh(/?«)] n ’ 


(3.29) 


in terms of the functions g q {u ; n). Turns out that all the functions g q parameterizing 
the eigenvectors of the sector D^°\ are by themselves the eigenfunctions of an integral 
operator associated to that sector. In fact, expressing the linear terms in Eq. (3.17) 
through the identity 


d 


d 


17(11 ''' ^ de ai -"de a 


E a 


e^a 


(3.30) 


e=0 


and plugging Eq. (3.29) into the eigenvalue equation T n 'ijj q = \ il> q , we obtain, after 
some manipulations, the new eigenvalue equation 

/ /du\i 

dv d(u-u(J,h + v)) Z n (J, h, v) g q (v; n). (3.31) 


The function u(J, x), defined by 


u(J, x) = — atanh (tanh(/3J) tanh(/?x)), 
y 


(3.32) 


will be recognized by the learned reader as the update rule for cavity messages. As 
we shall see, the function 


Z{ J, h, v ) = 


2 cosh(/3 J) cosh ( f3(v + h )) 
cosh(/3u) 


(3.33) 
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is related to the intensive free energy of an chain. Notice that in writing down Eq. 
(3.31) we have shifted the problem of finding a complete bases of eigenvectors for the 
matrix T n to the equivalent problem of the spectral decomposition of the integral 
operators of Eq. (3.31), for q = 0,..., [^J. Turns out that, for a given sector D^ q \ 
the integral operator has a set of left eigenfunctions in the form 


Sg(v;ri) = E h 


d u gq(u;n ) 


cosh (P(u + v + h)) 
2 cosh (/3u) cosh(/3u) 


n 


1 — tanh 2 (/3(u + v + h)) , 


(3.34) 

as can be inferred from Eq. (3.20) and can be directly verified. In the rest of the 
chapter we will assume that the left and right eigenfunctions of the sector 
satisfy the normalization condition 


d u Sq(u] n) Qq (u] 71 ) = 5 X \> 


(3.35) 


derived from Eq. (3.22). We are now ready to take the n 0 limit and discuss its 
non trivial aspects. 


3.3.3 The small n limit 

In the limit n|0 we obtain an infinite number of sectors D^ q \ q = 0,1,..., in a 
fashion that is characteristic to replicas computations. Setting n = 0 in Eq. (3.31) 
we obtain Eq. (3.4), which we rewrite for convenience: 


r /du\ q 

A gq{u) = Ej, h j d v 5 (u- u(J, h + v)) J g*(v) . (3.36) 

From now on we shall refer to g^iv) as a solution of last equation and shall explicitly 
express the n dependence for the solutions of (3.31) at finite n. In Figure 3.2 and 
Figure 3.3 we show two examples of eigenvalues and eigenfunctions in the sector 
D h) and D ^ respectively. 

For q = 0 , i.e. in the sector D^°\ Eq. (3.36) admits a unique maximum 
eigenvalue A = 1 by Perron-Frobenius theorem. The corresponding eigenfunction is 
the probability distribution of cavity biases, which we call P(u) [15]. We have thus 
established a first connection between the cavity method and the RTM formalism, 
and we shall enforce this connection in Section 3.5. The other eigenfunctions of D ^ 
are characterized by / dw <?o( u ) = 0 at n = 0. It is convenient, to held compatibility 
with the normalization condition Eq. (3.35) as we will see, to impose a diverging 
scaling for all the eigenfunctions of D except for the first one: 




(3.37) 


The symbol ~ denotes equivalence between the r.h.s. ad l.h.s. up to higher order 
correction in n, and <?o is the first correction to the leading order of the eigenfunction 
in . Using Eq. (3.37) for the right eigenfunctions and considering also the 
correction in n to the eigenvalues, we can compute the left eigenfunctions of 
from Eq. (3.34). In fact we obtain at the leading order 


5o(u;n) ~ y/nS^v) = \Jn 


ca + E h J d u go{u ) log ^ 


/ cosh (/3(u + v + h)) 


cosh(/4u) 


(3.38) 
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Fig. 3.2. (Top) The leading eigenvalue Ai of the sector D ^ in the RFIM, as a function 
of the temperature and of the gaussian external field with variance <j 2 h . ( Bottom ) The 
corresponding right eigenfunction g\(u) at <th = 0.8 . The random fields h and h are 
distributed as the cavity fields arriving on a chain embedded in a RRG with connectivity 
z = 3, therefore the transition point is localized at Ai = |. 
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where is the normalization of the first order correction to the eigenfunction ^q, 
that is 

c A = Jdu g$(«) = ^ E h jdu g^u) log ■ (3.39) 

In all calculations involving the sector D we will express the eigenvectors using 
Eqs. (3.37) and (3.38), then proceed carefully to take the n | 0 limit. 

To find an expression for the left eigenfunctions in the other sectors no such care 
is needed to take the n / 0 limit in Eq. (3.34), therefore we straightly obtain 

Sq(v) = E/g J d u Qq{u) 1 — ta.nh 2 (f3(u + v + h )) for q > 1 . (3.40) 

The degeneracy between and corresponds to the degeneracy between 
the Longitudinal and Anomalous eigenvalues in the Hessian of the Sherrington- 
Kirkpatrick model [150,151]. The multiplicity of the eigenvalues in the two sectors, 
do = 1 and d\ = n — 1, sum up to give an 0(n) contribution as should be expected, 
while from Eq. (3.14) the other sectors have degeneracies of order 0(n ) without the 
need of further elisions. Therefore it is convenient to define 


for q = 1 , 




(3.41) 


The first eigenvalue of D ^ requires separate considerations. We define the 
coefficient /o from its n expansion: 


A (n) ~ 1 - /I/ 0 n. (3.42) 

As we already noted, the cavity messages distribution P(u) is the eigenvector 
associated to the largest eigenvalue of the sector D ^ for n = 0. The corresponding 
left eigenvalue is S(u) = 1. In Section 3.4.1 we shall see that /o is the intensive free 
energy of a chain. From Eq. (3.47) we obtain 

- Pfo = E j,h J log [Z(J, h, w)] P(v) . (3.43) 


3.3.4 The degeneracy between and 

A close inspection of the eigenvalue equation (3.36) reveals a surprising relation 
between the sectors D 1°) and at n = 0. It can be shown, respectively deriving 
or integrating both members of Eq. (3.36) for q = 1 and q = 0, that all the 
eigenfunctions of have a corresponding eigenfunction in with the same 
eigenvalue. On the other hand, all the eigenfunctions of D^°\ except for the first one, 
i.e. the ones having zero sum, have a corresponding eigenfunction in with the 
same eigenvalue. We have thus established a degeneracy between the Longitudinal 
and the Anomalous sectors. The following relations hold: 

9q{u) = j 3 d u gl{u)] ^d u S${u) = -Si(u). (3.44) 
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Fig. 3.3. (Top) The leading eigenvalue A 2 of the sector D^ in a J = ±1 spin-glass, as a 
function of the temperature and of the uniform external field H. The phase diagram is 
also shown in the H — T plane. ( Bottom ) The corresponding right eigenfunctions 32 ( 1 *) 
along the orange line of the top picture. The random fields h and h are distributed 
as the cavity fields arriving on a chain embedded in a RRG with connectivity z = 3, 
therefore the transition point is localized at A 2 = 
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Particular attention has to be taken in the limits involving these two sectors, 
keeping track of the 0(n ) corrections both to eigenvalues and eigenvectors. A double 
pole contribution to some observables, as we shall later see, stems from the first 
correction in n to the paired eigenvalues in D ^ and D^\ In fact if we define the 
eigenvalue shifts <5Ao and 4Ai by 

A 0 (ra) ~ A + ?r SX 0 , (3.45) 

Ai(n) ~ A + n (5Ai, (3.46) 

and consider the expansion to the first order in n of the eigenvalue equation (3.31) 
for q =, from standard perturbation theory we have 

/ / r)n) \ Q 

dudv Sg(u)log[Z(J, h,v)\d(u-u(J, h + v)) y—J 9 q{v). (3.47) 

The shift difference A a = <5Ao — 4Aj is the relevant quantity we are looking after, 
since it arises in the calculation of the free energies of closed chains and of the 
thermally disconnecter correlation function, see Section 3.4. Using Eq. (3.47) and 
the relation (3.44) between the eigenfunctions in the two sectors, we obtain the 
expression 

Aa = —IE j t h J drtdu S^(u)5 (u — u(J, v + h )) [tanh (f3(v + h)) — tanh(/3u)] gi(v) 

(3.48) 

If we call (•, •) the scalar product in L 2 and define the kernel 

Q(u, v ) = 5 (u — u(J, v + h )) [tanh (f3(v + h)) — tanh(/3u)] , (3.49) 

then Eq. (3.48) can be rewritten as 

Aa = -(S 0 \Q 5i a ). (3.50) 

In the next Section we shall apply the formalism we have developed to the computa¬ 
tion of some physically relevant quantities. 

3.4 Some Applications of the formalism 

3.4.1 Free energy of chains 

Let us first consider the average free energy of a closed chain of length £, each node 
receiving i.i.d. random fields h, and call it ff . If the chain considered is embedded 
in a locally tree-like graph, the random fields h are distributed according to the 
cavity messages distribution on that graph ensemble. Since Tr T is the replicated 
partition function of this system, the free energy is given by 

-/S/I = lim a, TV 7^, (3.51) 

n—>• 0 

where, thanks the orthonormal decomposition of T n , the trace can be written in the 
form 

n 

T i< = ±d q £ A*. 

<?=o a e£>(«) 


(3.52) 
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In last equation the eigenvalue degeneracies d q are given in Eq. (3.14), and the 
eigenvalues A depends implicitly on n. In the small n limit the sum over q can be 
extended to infinity. The considerations over the eigenvalues’ shifts and degeneracies 
of last Section lead to the final expression 

OO 

-Pfe=-P*fo+ E Aa^ 1 +E4 E A ^ ( 3 - 53 ) 

A eDW 9=1 A eD(i) 

The coefficients d q are given by Eq. (3.41), the shift differences given by Eq. 
(3.48) and an expression for the intensive free energy /o is found in Eq. (3.43). We 
notice that all the quantities entering Eq. (3.53) can be expressed in terms of the 
eigenvalues and eigenfunctions of Eq. (3.36). 

The computation of the average free energy of open chains is a little more 
involved. In the definition of open chains, we allow the spins at the extremities to 
receive a random field h that could have a distribution different from the one of the 
fields acting on the internal spins of the chain. We introduce this relaxation of the 
model in order to apply our formalism to the case of open chains embedded in a 
generic tree-like random graph. 

It is convenient to define the replicated partition function of an open chain of 
length £, conditioned on the configuration of the replicated spins at its extrema in the 
following way: starting from Tp we remove the field h on the right and substitute it 
with a field h, then we add the other field h on the left (see Figure 3.1). Therefore 
we define 

Ti e) (<r, t) = p~ h {a) T^(a, r) pjp (t) p~ h {r) , (3.54) 

where, with a little abuse of notation, the vector p^ is defined by 

p h (a) = K h e^a- a . (3.55) 

By definition the matrix is symmetric (see Figure 3.1 for a pictorial representa¬ 
tion). From Eq. (3.54) and Eq. (3.24) we obtain the spectral decomposition 

L-J 

T{p(<r, t) = E E Ph( a )Pq( a )P~h( T )Pq( T ) E Qa 1 ...a q ;b 1 ...b q <T ai ■ • • (T^T^ . . . 

q=0 \££>(q) ai<—<a q 

bi<---<b q 

(3.56) 

The average free energy of an open chain of length t is then given by 

- pfi = lim <9 n Y, f nX°iT) . (3.57) 

n —^0 z — 

<T,T 

From Eq. (3.56) it easy to see that only the D ^ sector of T,P contributes to last 
equation. 

A different behaviour characterize the terms corresponding to the leading eigen¬ 
value at n = 0 (the cavity one) from the others. As in the case of the closed chain, 
the extensive contribution to the free energy comes from the leading eigenvalue of 
TH°1, A ~ 1 — n/3fo■ An 0(1) contribution comes from the leading eigenfunction 
(/o (u; n) = P(u) + 0(n), while each other eigenvalue, the ones degenerate with D^°\ 
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gives an exponential term. Therefore, after a careful treatment of the small n limit, 
we arrive to the expression 


—fife = — £/3fo + % J du P(u) 2 log cosh + h)^j 

— Eh j chicb P(u)P(v) log cosh (f3(u + v + h)) (3.58) 

+ log 2 + ^2 a 1fi ^ > 

Ae-Dh) 


with 


1 


«A,0 = 


K h / du g$(u) log 


A — 1 

+ % f du Qq (u) log 


cosh (/3(u + h)) 


cosh (/3u 
cosh (j3(u + h)) 
cosh (f3u) 


(3.59) 


In Eq. (3.58) it is clearly expressed at the order 0(1) in i the free energy shift, with 
respect to the free energy of a closed chain, due to the addition of two extremal 
spins and the removal of an internal one. 

The coefficients a\ y o are strictly related to the left eigenfunctions Sq defined in 
Eq. (3.38). In fact if the random field at the extremities of the chain are distributed 

as the one on the internal spins, i.e. h = h as in the case of a chain embedded in 
a Poissonian random graph, then aA,o = Sq(0). More generally if a probability 
distribution G ^ (u) exists such that 


P(h) = E fc J du G (0) (u) S(h -{u + h )) 


(3.60) 


holds, then Eq. (3.59) can be written in the compact form a\fi = (Sq,G^). 

Obviously if h = h we have G^°\u) = S(u). For a chain embedded in a random 
regular graphs ensemble instead, G^°\u) is given by the distribution of cavity biases 
Pcav(u) [15], which corresponds to the first eigenvector of the Longitudinal Sector. 
Therefore in the random regular graph ensemble (Sq, G ^) = 0 and no exponential 
decays are present in the expression (3.58) for the free energy of open chains. 


3.4.2 Correlation functions 

We take advantage of the spectral representation of the RTM to find some analytical 
expressions for the two-point correlation functions. We consider two spins, cro 
and at, at distance £ along a chain. As in the previous paragraph, we admit the 
possibility for the chain to be embedded in a locally tree-like graph, therefore 
the random fields h acting on a o and at can be distributed differently from the 
fields h on the internal spin of the chain. The decomposition of Tn\a,r ) in Eq. 

(3.56) can be exploited to obtain the correlation functions. In fact contracting 
~ £ 

T n (a, t) with two spins having the same replica index constrains them to be 
in the same thermal state, as in {a^at) = lim n _*.o T a 1 Tn\a,r) t 1 . Choosing 
different replica indexes instead corresponds to choosing different thermal states, e.g. 
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(ao)(ae) = lim n _>o Yhar (jl t) t 2 . Generalizing this considerations is easy to 

obtain 

(c To cr e) k = lim a 1 ... a k f^\a, r) t 1 ... T k . (3.61) 

n —^0 L ' 

CT,T 

Since vectors of the form a 1 ... a k have non-zero projections in D^ only for q < k, 
only these sectors of the spectral representation of TrP contribute to Eq. (3.61). 
The expression for (cro 0 '(.) k is quite complicated and it involves also the correction 
for small n to the eigenfunction of and D^\ as in the case of the thermally 
disconnected correlation function we shall later see. Therefore, since this kind of 
correlation function has little physical relevance, we won’t report its expression in 
terms of the transfer matrix eigenvalues and eigenfunctions. 

Far more interesting from the physical viewpoint are the connected correlation 
functions. The ferromagnetic connected correlation functions can be expressed as 
(oo (Tg)c = linirwo \ Ea,r ( al “ a ' 2 ) Tn\cr, r) (r 1 - t 2 ), as one can rapidly check, 
and this expression can be easily generalized to 


MS = lim i £ (,' - S) ... - <r“) r<V, r) (r 1 - r 2 )... (r 2 ‘~' - T 

<T,T 

(3.62) 

It is worth noticing that the vector v = (a 1 — a 2 ) ... ^cr 2fc_1 — a 2k ^j belongs to the 

subspace D^ k \ therefore we can choose a basis for the spectral representation of 

~rg) 

Tn ' such that all but one vectors are orthogonal to v. This leads to the following 
compact expression for the connected correlation functions: 


{<ro<re)% = Y a \k ^ i 

A eoW 

with the coefficients a\^ given by 


®A ,k — 


I 


d u g%(u) 


1 



(3.63) 


(3.64) 


As in the case of the coefficient a\ i o dehned in Eq. (3.59), if a solution G^ of 
(3.60) exist then a\^ is simply given by the projection of G^ on S%, that is 

a x , k = (S£,G^). ’ _ 

The susceptibilities Xk = lim m^oc yr J2i,j ( (J i (J j)c can be easily computed through 
equation (3.63) in a random graph with mean degree and mean residual degree zq 
and z respectively. In fact in thermodynamic limit we have 


Xk = (1 - rn 2 ) k + Y z ^ £ 1 ( a oat)* 
t=\ 

A 


= (1 - m 2 ) k + z 0 Y a l,k Y 

A eD( fc ) 


— z A 


(3.65) 


At a transition point the largest eigenvalue of one of the sectors reaches the value 
- and the corresponding susceptibility diverges. Assuming a smooth behavior for the 
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eigenvalue in the high temperature region before the transition, A(T) = - + 0(T — T c ) 
for T —i T+, we obtain the mean-field critical exponent 7 = 1 . 

The computation of the thermal disconnected correlation function (do) (<7 (), 
relevant to the RFIM transition, is more complicated, since it involves the sub¬ 
leading corrections in n to the eigenvectors of T n . Great care has to be taken in 
the limit lim n _ ) .o J2a, T 0-1 Tn\a, r) r 2 = (do)(d^). As in Eq. (3.37), let us call c/q(u) 
the correction to the eigenfunction g$(u). We denote with (m) q the expectation over 
fn\cr,T ) restricted to the sector D^ q \ Than in £>(°) we obtain 


(d i r 2 ) 0 ~ (doo ) 2 + -a 2 xl X £ + a 2 xl £5X 0 X 


’-1 


A EDW 


— 2oa.i A 


d u c/q(u) tanh(/3(u + h)) 


(3.66) 


+ du go(u) tanh(/3(u + h ,)) log 


cosh(/3(u + h)) 
cosh {(du) 


where the contribution (d^) comes from the cavity eigenvector and is the average 
magnetization of a spin at the end of an infinite chain. 

Similarly, if we define §i(u) by <?i(u;n) ~ g±{u) + ngi(u), in the sector we 
have 


U\ 


(dV 


-1 


E —<i^'-<i^A,A 


i-i 


A GDW 

- 2a x>1 X £ 

L 

+ f dri gi(u) ^1 — tanh 2 (/?(u + h)) ) log 


du gi(u) (l — tanh 2 (/3(u + h))') 

cosh (/3(u + h )) 
cosh(/3u) 


(3.67) 


Summing the two contributions, the final result for the disconnected correlation 
function is 

(do)(d£) = (doo) + E a A,i ^ ^ 1 + a x X e . (3.68) 

A edW 

Therefore each eigenvalue of the Anomalous sector contributes to (do) (d^) with an 
simple exponential term and with a term that leads to a double pole behaviour in the 
associated susceptibility, with coefficients A a given in Eq. (3.48). The coefficients 
a x of the exponential decays instead are given by 


a\ = 2 av,i 


du gi (u) tanh(/3(u + h)) (tanh(/3(u + h )) — tanh(/3u) 


du gi(u) ^1 — tanh 2 (/3(u + h ))) — f du g^u) tanh(/3(u + h )) 


(3.69) 


Since the magnetization of a spin conditioned to be to be the extremity of a 
chain of size ^ is given by 


{at) = lirn Ed 1 T^(d,r) = (d^) - E a A,iaA,oA £ , (3.70) 

n "° XgDW 
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if we call A the highest eigenvalue of the sector the most relevant contributions 
to the thermally-disconnected disorder-connected correlation function is given, for 
t —> +oo, by 

(fo)(^) - (co) {(Tt) ~ A a a A,i ^ A f_1 + (a A - 2 ( 0 - 00 } a Aj ia Ai0 ) A 1 . (3.71) 

We notice that, while the coefficient of the exponential term is quite hard to compute, 
the coefficient a\ 1 A a , which regulates the leading behaviour, has a much simpler 
expression given in Eq. (3.48) and Eq. (3.64). From Eq. 3.71 turns out that near a 
ferromagnetic transition point, i.e. A = ^, as long as A a is not zero, the leading 
behavior of the disconnected susceptibility Xdisc = Yhi,j ( £J o)(c r t) — (<7o) ( 0 ^) reads 

Xdisc — z o A a o a 1 — zA'jZ ' (3.72) 

The expected double-pole behavior of the disconnected susceptibility is thus recov¬ 
ered. 


3.5 Cavity derivation 

In this section we present the derivation of several of the results of last Section using 
a probabilistic approach, in the same spirit of the usual cavity method calculations 
[13,15]. While this approach is more physically intuitive than the RTM formalism, 
it requires the set up of an ad-hoc recursion rule for each observable. Noticeably we 
could not recover Eq. (3.53) for the free energy of closed chains. 


3.5.1 Open chains 

We want to study the statistical properties of a random Ising open chain without 
the use of replicas. We start with an asymmetric chain of length £, whose random 
partition function we denote with Zg, constructed iteratively according to the 
following procedure: Zq is the partition function of a single spin receiving a random 
field no, i.e. Zq = 2 cosh(/3«o); at the z-tli step of the construction we add a spin 
0 i, a random coupling J* between a, and <7,_i and a random field /q_i on cq_i; the 
random variable Zg is the partition function of the system obtained after the 7-th 
step of the procedure. Note that the last spin added to the chain has no external 
fields acting on it. The following distributional identity can be easily derived: 


Ze+i 


2 cosh(/3J^) cosh(/3(u^ + hg)) 
cosh (f3ug) 


x Zg — Z(Jg, hg , ug) x Zg. 


(3.73) 


It is convenient to introduce the quantity Zf(u) = 5(u — ug ) Z™, which corresponds 
to the expectation of Z” along with the indicator function of the event ug = u. Here 
n is an arbitrary chosen positive real number, the symbol being chosen to stress the 
analogy with the replica formalism where the quantity n (integer in this case) is the 
number of replicated systems. Using this definition from Eq. (3.73) follows readily 


Zg +1 (u) = Ej :h j dv 5 (u - u(J,v + h)) Z n (J,h,v) Zf(v), 


(3.74) 



3.5 Cavity derivation 


53 


where u{J,x ) = jj atanh(tanh(/3J) tanh(/3x)) is the usual message passing rule. The 
integral operator of Eq. (3.74) is the same we found in the RTM formalism in Eq. 
(3.31) for the sector D^°\ therefore we can make use of the spectral analysis result 
from those paragraphs, in particular of the completeness relation 

Ej, h S(u-u(J,v + h)) Z n (J,h,v) = X(n) go(u;n) S$(v,ri), (3.75) 

A e£>(°) 


between left and right eigenvectors. The definition of the left eigenfunctions of D 
was already given in Eq. (3.34), but we rewrite it for convenience: 



cosh (f3(u + v + h )) 
2 cosh(/Lu) cosh(/3u) 


n 


(3.76) 


Let us define another random partition function, Z^(u\ x), obtained from Zi{u) 
conditioning on the value of the message uq on the first spin, that is Zp{w. x) = 
Zi(u)\(uq = x). Since also Z™(u\x) as a function of u obeys equation (3.74), using 
the decomposition Eq. (3.75) and the initial condition Zq = 2cosh(/Luo) we arrive 
to the important result 


Zf(u\x)= ^2 A^(n) < 7 g (u; n) 5 q (x; n) [2 cosh(/3x)] n . (3.77) 

Aer>(°) 


Using last equation it is easy to compute any moment Zf, n not necessarily integer, 
of the partition function of a random asymmetric Ising chain of length £. More 
interesting is the computation of the properties of a symmetric Ising open chain, the 
one considered in Section 3.4.1, which receives on each extremity an external field 
distributed according to a certain probability distribution P(h). As already stated, 
this is definition stems from the need to cover the important case of a chain embedded 
in a locally tree-like graph. Let us call Z( 0 the random partition function of this 
open chain. It is related to the random partition function Zi of the asymmetric 
open chain by 

cosh (P(u e + h e )) 2cosh(/3J 0 ) cosh(/3h 0 ) . 

Zi,o = - ,,o r - X Ze-i{uf,ui) x - - (3.78) 

cosh (p ug ) cosh (pui) 

where u\ is distributed as u(Jo, ho). From Eq. (3.78) along with Eq. (3.77) and Eq. 
(3.76), we derive the main result of this paragraph: 

Zf 0 = J2 A*(n) a^,(n). (3.79) 

A eD(°l 


where a\ t o(n) is dehned by 


a\,o(n) = E~ h 


du 


cosh(/3(u + h)) 
cosh (f3u) 


9o{u]n) 


(3.80) 


In the RTM formalism of Section 3.3 and 3.4, last expression could be derived 
from Tn ' > dehned in Eq. (3.56) by analytic continuation of Z™ Q = J2a, T Tn\cr,T) to 
non-integer n. 
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The average free energy of an open chain of length t can then be obtained by 


-/?/;= lima,^ (3.81) 

n —>-0 ’ 

The computation involves computing the order n of all the quantities present in Eq. 
(3.79), as it was done in Section (3.4.1). In this paragraph however, without any use 
of replicas, we gave a purely probabilistic argument valid for any real value of n. We 
refer therefore to Section (3.4.1) for the successive step of the computation of f°, 
leading to the final result Eq. (3.58). Notice that in the notation of that paragraph 
aA,o is related to a\ t o(n) defined in Eq. (3.80) by a\^(n) ~ ^Jn a\fl. 

The expression (3.58) for f° could also be obtained by a different approach that 
does not involve any limit n j. 0 but is technically more difficult. We define the 
function (p^\u ) by 

<ip^\u ) = 5{u - u e ) log Zg, (3.82) 

and observe that given the distribution of the cavity message at distance t along the 
chain, ut, which we call (u ), it obeys the iterative rule 


tp^ +1 \u) = E J dv 5 (u — u(J, h + v)) ip^\v) 

_ f . . . A/TJ ... [2 cosh(/3 J) cosh(/3(v + h)) 

+ Ej, h / du 6 (u-u(J,h + v)) log 1 n 


cosh(/?u) 


G ( o\v) 

(3.83) 


Last equation can be solved decomposing <p^(u) and Gq\v) along the eigenfunctions 
of at n = 0, then <pW(u) can be used to obtain /°. 


3.5.2 Connected correlation functions 

Let us derive the eigenvalue equation (3.4) and the expression for the connected 
correlation functions Eq. (3.8), without making any use of replicas. Here we consider 
straightly the random open chain with partition function Zt i0 , characterized by 
independent random external field distributes a h on the internal spins and as h on 
the extremities. The connected correlation function (aoc r e) c = j , where Hq is 
an auxiliary field acting on do, can be expressed as a function of the message v,(, 
coming through the chain to the spin at, and its derivative with respect to Hq. In 
fact we have 

(<7o ot) c = (f - tanh 2 (/3(h e + u e ))^j (3.84) 

where ht, as usual, is the random effective field acting on at and coming eventually 
from the rest of the graph. Let us define the random variable X( by Xt = The 

average over disorder of Eq. (3.84) and its moments ( a§at)% can then be computed 
once we know the joint law of the random variables ut and Xt , which we call 
Pt(u,X). Since Xt obeys the chain rule Xt+ 1 = d 'g v + ' X( the recursion rule for Pi 
reads 


J dv d Y 5 



6 (u 


u(J,h + v)) Pt(v,Y), (3.85) 


Pt + i(u,X) = E j t h 
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where u is the message passing rule defined in Eq. (3.32). From last expression it 
turns out we can write an iteration rule for the momenta of Xp at fixed U£, 


GW(u) = f dX P?{u, X) Xi , 


(3.86) 


which reads 


G^ +l \u) = E j, h J du 8(u-u(J,h + v)) Gf\v). (3.87) 

Equations (3.85) and (3.87) with q = 2 have been recently introduced in literature 
[146] in order to derive an analytical expression for the spin-glass susceptibility. 

We note that the knowledge of the maximum eigenvalue of the integral operator 
of Eq. (3.87) for a generic q allows one to reconstruct the full distribution of the 
connected correlation function at large distance [152]. 

From last equation it is clear the relation of Gq ' with the eigenfunctions g* of 

Eq. (3.4). In fact, decomposing G q { \u) along the eigenfunctions of D^°\ projecting 
Eq. (3.87) on the left eigenvectors S q (u) and with some computations analogue to 
the ones leading from Eq. (3.79) to Eq. (3.80), we arrive to 

Gfw = E «a,,A(3.88) 

A £D(i) 

where a\ >q is defined in Eq. (3.64). Equation (3.88), along with Eq. (3.84), gives the 
expression (3.63) obtained with the RTM formalism for the connected correlation 
functions. 

Following the lead of the previous paragraph, we can extend the above derivation 
to compute the disorder averages along with an arbitrary power of Z^ a . The 

generalization of Eq. (3.87) in fact becomes 

G[ e+1 \u-n) = E J)h J dv 5(u-u(J,h + v)) Z (J, h, v) G^(v; n) , (3.89) 

and Eq. (3.88) generalizes trivially as well. The final result is 

{a 0 a e ) q c Zl 0 = E A V) «L( n )> ( 3 ' 9 °) 

a er>(«) 

which extrapolates smoothly to the result we obtained for n = 0, i.e. Eq. (3.63). In 
last equation the coefficients a\ tq (n) are defined by 


a\, q {n) = E~ h 


[ d u 

cosh ((3(u + h)) 

n 

1 — tanh 2 (/3(u + h)) 

1 

cosh(/3u) 




9q{u;n ) 


(3.91) 


such that oa i9 (0) = a\ :q . 
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3.5.3 The disconnected correlation function 

The computations of the thermally disconnected correlation function (<7o) (<j() is 
straightforward once we use the results we obtained in the two preceding paragraphs. 
In fact, calling Hq and He two auxiliary fields we add to the first and the last spin of 
the chain respectively and set to zero after the computation, the following relation 
holds: 

Mo = n { ' a ° Ul ' )c Z ^° + n * Z t,o■ ( 3 - 92 ) 

Using Eqs. (3.79) and (3.90) last expression leads to the main result of this paragraph, 
that is 

A V) b l,o( n ) ~ A V) a li( n )> (3-93) 

A eD(°) A £DW 

where the coefficient b\jj(n) = reads 

b\ y0 (n) = E~ h j du tanh(/3(u + h)) Vngo (it; n). (3.94) 

We included a factor sjn in the definition of &A,o( n ) to facilitate the extrapolation 
of Eq. (3.93) to small n. In fact for all but the first eigenfunctions of D the 
normalization condition imposes the scaling ^(tqn) ^bo(«) + n 9o(u)}- 

We could derive Eq. (3.93) also in the RTM formalism for integer values of n 
and then perform an analytic continuation to arbitrary real n. In the limit n 0 it 
is easy to see that the contribution to (<ro) (ere) from the first and the second sums 
of Eq. (3.93) are given in Eqs. (3.66) and (3.67) of Section 3.4.2 respectively. 

An alternative probabilistic derivation of the formula (3.68) for (<ro) (cr^), which 
does not require the knowledge of the moments of the partition function and of 
(<To oe) c Z™ Q , goes through the definition of 

R^\u) = 5(u — ue)(a o)W. (3.95) 

We used the symbol (<to)^ to denote the magnetization of the first spin at the 7-th 
iteration of the construction of the asymmetric chain described in Section 3.5.1. 
It can be easily shown that the knowledge of R^\u) allows the computation of 
{(To)(crz). Since (oo)^ is given by the derivative of the free energy of the chain at 
the step i with respect to a held on the the first spin, considering the free energy 
difference after an iteration it is easy to arrive to the relation 

(co} (m) = (oo) W + [tanh (j3(u e + h)) - tanh (/3u £ )\ (3.96) 

on o 

Therefore the recursion rule for R^\u) is given by 

R^ +1 \u) = E Jth j du R W (v) 5 (u - u(J , h + v)) 

+ E jh J du G±\v) 5 (u — u(J, h + v)) [tanh(/3(u + h )) — tanh(/3u)], 

(3.97) 


(a 0 )(ae) Z n t o = ^ 
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where G^\v) was defined in Eq. (3.88) in last paragraph. Last equation can be 
solved decomposing R^\u) along the eigenfunctions of D at n = 0, and using 
Eq. (3.88) for G^\v). The computation is lengthy and not trivial, since it involves 
expressing and cji (defined in Section 3.4.2) respectively in terms of the basis of 
D and at n = 0. In the end though one arrives at the expression (3.68) for 
the disconnected correlation function. 


3.6 Conclusions 

In the present chapter we presented a thorough analysis of the spectral properties of 
the RTM. We have developed a formalism that is suitable to compute many different 
types of connected and disconnected correlation functions and can be applied both 
to one-dimensional systems and to locally tree-like graphs. The expressions we found 
are exact for any value i of the spin distance and can be approximated numerically 
considering only the top eigenvalues of certain integral operators. Also the formalism 
can be trivially adapted to perform the same computations in diluted p-spin models. 

We also managed to obtain exact formulas for the moments of the partition 
function and of the average free energies of open and closed chains of finite length. 
It has been recently found that short chains have an important role in the finite 
size corrections to disordered models on diluted graphs [2] and in perturbative 
expansions around the Bethe approximation on Euclidean systems [148]. Therefore 
the analytical tools we have developed also apply to these contexts. 

Most of the results have also been derived using rigorous probabilistic arguments. 
This approach has the merits of avoiding the complication of the decomposition of 
the replicated space Zf n and of being more physically intuitive than the replica one. 
The advantage of the replica method instead is that once the spectral representation 
of the RTM is obtained all the observables can be computed just with opportune 
contraction. In the cavity analysis an ad-hoc iterative function or a computation 
strategy has to be devised for each observable. 

Noticeably we did not manage to derive Eq. (3.53) for the free energy of closed 
chains using a cavity argument. This is the only point withstanding the proof of the 
complete equivalence between the two methods. 

A limitation of both the RTM formalism and of its cavity counterpart, is the fact 
that it is applicable to the analysis of disordered Ising models only in their replica 
symmetric phase. This includes all isolated one-dimensional systems but not diluted 
models in the spin glass phase. Therefore an investigation of the spectral properties 
of the 1RSB replicated transfer matrix, extending Wigner’s decomposition [149] 
to the 1RSB symmetry group, is desirable. Another direction for the extension of 
our results, which should not require too much analytical effort [153], is toward the 
investigation of Potts models. 
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Chapter 4 

Finite Size Corrections On 
Random Graphs 

4.1 Introduction 

Finite size corrections to the thermodinamic free energy have been investigated in 
fully connected systems [116,117,154], mean field optimization problems [93,95] 
and some simple disorder system [155], sometimes as a byproduct of the Hessian 
diagonalization [156]. However, to our knowledge, only a solution in zero external 
field has been derived for sparse random graphs [157,158] in the replica symmetric 
phase. 

In the domain of physical spin systems, diluted models represent a class of 
mean-field like systems sharing an essential feature of the finite-dimensional ones, 
that is the finite coordination number. By consequence diluted models should mimic 
the physics of real systems better than the fully-connected ones (we have already 
remarked that this is what happens for zero temperature ferromagnets in random 
magnetic fields). Moreover when dealing with finite systems, the peculiar structure 
of diluted networks should give a first insight on how the topology can modify 
thermodynamic quantities. Indeed diluted models are defined on random graphs 
which are locally tree-like and have typical loops of size O(loglV). However for finite 
(and small) sizes these loops become short and much more similar to the short loops 
which are abundant in any finite-dimensional network (think e.g. to lattice models). 
In this sense we can interpret the 1/N corrections in diluted models as a way to 
expand towards finite dimensional models. 

In the thermodynamic limit the free energy of diluted systems is exactly the 
Bethe free energy. When the number of vertices N in the graph is finite though, the 
average free energy density /(IV) resents the presence of loops. If f(N) has a regular 
expansion around N = oo, each term of the 1/N expansion f(N) = fo+fi/N+o(l/N) 
would account for the contribution of a certain class of loopy structures. We see 
that in the context of diluted systems, finite size corrections and loop expansions 
are strictly related concepts. In this Cshapter we set up a formalism, based on 
a replicated action, apt to the systematic computation of the /(IV) expansion for 
diluted disordered Ising systems in the replica symmetric phase. We calculate 
explicitly the first correction to the thermodynamic free energy. It is simple 
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combinatorics to show that only simple (i.e. non-intersecting) loops can participate 
to the 0(1/N) correction f\. In fact more complicated loopy subgraphs, with 
no dangling edges, typically involve only a fraction 0(1/N 2 ) of the total number 
of nodes, therefore can only contribute to higher order terms in the free energy 
expansion. Obviously this fact naturally emerges from the analytic computation as 
well. 

In the following we will use the replica method in order to compute disorder- 
averaged corrections to the free energy. Then we will rederive the same results using 
a probabilistic approach. 

We will deal with random regular graphs (RRG) and Erdos-Renyi (ER) graphs 
topologies. The replica procedure used is very similar, but is more involved in 
the RRG case, so we will describe in greater detail in the ER case, and leave 
most details of the RRG computations to Appendix B. On the other hand the 
combinatorial/probabilistic arguments are very different instead, the one for RRGs 
much shorter since it relies on the expression for the free energies of open and closed 
chains obtained in Chapter 3. In both ensembles we corroborate the analytical 
results with numerical simulations, conducted on RFIMs and spin-glass systems. 

The results obtained and the method used in this Chapter, in particular for the 
RRG ensemble, are the foundations for the large M expansion for finite dimensional 
systems presented in Chapter 8. 

4.2 Erdos-Renyi 

4.2.1 The model 

We consider a model of N interacting Ising spins {cr* = ±1}^ 1 defined by the 
following Hamiltonian: 


1~L — 'y ] Cjj JijO’i&j y ] hjCTj , (4.1) 

i<j i 

where we have decoupled the topology of the underlying graph, encoded in the 
symmetric adjacency matrix {C' y }, from the exchange interactions {}. The 
numbers C t j specify the particular graph considered and take values Cij = 1 or 0 
whether the sites i and j are connected or not. In the case of Erdos-Renyi random 
graphs [159], the matrix C has the following distribution [160]: 


mcij}) = n 

i<j 


-5(C tJ - 1) + 1 - - *(Cy) 


N 


N 


(4.2) 


The spins interact among each other via quenched random couplings Jj-j , which 
are assumed to be identically independently distributed (or fixed to a single value 
J). Moreover we allow the spins to interact with a local magnetic field (random 
or non-random). The disorder averaged free energy density of the system, at the 
temperature T = /3 _1 , is defined as 

mm = -(pn r 1 [i og z N m av = + ^w)+«(^), ( 4 . 3 ) 
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where the average has to be performed over the topological disorder and the quenched 
randomness. The main part of this work is devoted to the analytical computation 
of the /i(/3) term, the finite size correction to the free energy. The calculation can 
be performed in two different ways, known as the replica method and the cavity 
method. The latter derivation is particularly useful in order to better understand 
the physical meaning of the results, which is less clear in the replica picture. 

4.2.2 Computing the free energy density with replicas 

The replica calculation of the free energy density starts from the well known identity: 

[logZjv(0)] av = Hm J^log [{Z n (P)Y\ v . (4.4) 

The moments of the partition function [(^7v(/3)) n ] av are then evaluated for integer 
values of number of replicas n. At the end of the calculation, the analytical continu¬ 
ation to real values of n allows us to take the limit n —>■ 0. The replicated averaged 
partition function reads (from now on we drop the dependence of Zjy on /?): 


K^v) n ] av = 


I U ll 

Tr Yl ex P ( PJijCij Y a i a j) II ex P (P h i Y 


Vi 


<l<3 


(4.5) 


Performing the average over the topological disorder using the distribution (4.2), 
and setting 


V ( a , t) = N log 
B(a) = log 


1 + — exp (f3J Y, v a T a ') — 1 


exp i 


(/w*E 

a 

eq. (4.5) takes the following form: 




(4.6) 


"2 N V ^ a) ' 


[(Z N ) n l v = Tr 


ex P \ F ^> a ^ + Y 


Vi 


h3 


(4.7) 


We can achieve the site factorization of eq. (4.7) by means of the order parameter 


p{a) = N 1 5Zn <y ( <7 ° _ 


V,; 


(4.8) 


Enforcing Eq. (4.8) with a 5 functional in Eq. (4.7), we trace over the decoupled 
sites and then integrate out p{v) which appears in Gaussian form. We arrive at an 
expression for the auxiliary fields p(a) suitable for saddle-point evaluation: 1 


l(z«)"].. = \/d e t(K) j{Dp]e- NS M . 


(4.9) 


1 The functional measure is [Dp] = TL \/H d p(v) 
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The replicated action 5[p] is given by 


j dudr p(a) V(a, r)p(r) — log J dcrexp 

/ dr L (a, r)p(r) + B(a) 


(4 


1 °) 

where the symbol “/ da ” is a proxy for the more cumbersome notation f da = 
ns=i z)o- a =± i . Let us now extract the leading order contribution in the replicated 
action S[p]. We define the matrix U(a, r) and the vector H(a ) from the first order 
expansion in N of eq. (4.6) to be 

-J 


(4.11) 


U{a,r) = exp (/3J^ 
H(a) = log 


exp 


(»E 


a L 


and write the thermodynamically relevant part of the action (4.10) as <S[p] = 
S'of/o] + o(l), where 

S 0 [p\ = - J dadr p(a) (U(a,T)-l)p(T)-lo g Jdaexp z J dr (U(a, r) - l)p(r) + H(a) 

(4 - 12) 

The leading order free energy /o comes from the saddle point of eq. (4.12), followed 
by the limit n —> 0, as we will see in the next section. A first O correction to 
the free energy comes from the O (1 /IV) term in eq. (4.10) evaluated at the saddle 
point. 

Leading free energy 

We now evaluate the functional integral (4.9) by the steepest descent method: 

(4.13) 

where p*(a) is the solution of the the saddle-point equation: 


JV S+oo _ ^ 1Og[(Ziv)n] - = 50N 


SS 0 [p] 


= 0 


p*(a) = 


exp [z J d a'U(a, a')p^(a') + H(a )] 


(4.14) 


dp(a) ' ' J daexp[z J da'U(a,a')p.,:(a') + H(a)] 

In order to take the small n limit we have to use an appropriate parametrization 
for the order parameter p*(cr). If we assume a Replica Symmetric (RS) ansatz, a 
convenient parametrization for p*(a) is given by 

fexp(/?/i£ a <7" 


p *(<t) = J dhP(h) 


(2ch (Ph)) n 1 ' (4 ' 15) 

Inserting this parametrization in eq. (4.14) and taking the limit n^Owe obtain the 
usual self-consistent Cavity equations for the distribution P(h) and Q(u) of cavity 
fields and bias respectively: 

~h-R 


°o 


- L *r 


k=0 



6[h-h R -Y,' 


Q{u) = J dP(h) 5 


1 


u —-th 1 [th(/3J)th(/3/i)] 
P 


i =1 
■J 


(4.16) 
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The RS free energy density can then be estimated as 

/o(/3) = Z?" 1 lim ^-So[p*] 


(4.17) 


and can be explicitly written in term of the distributions P{h ) and Q(u) [15]. 

Fluctuations around the RS saddle point 

The Gaussian integral obtained by expanding eq.(4.10) around the saddle point 
generates the order 1/N corrections. We set 

, x(^) 


p(a) = p*(cx) + 


Vn ’ 


q(2) / / ^ S 0 [P] 

dp(a)5p(a') 

Expanding the action in powers of 1/N we find 


(4.18) 


S[p] = <So[p*] + ^Si[p*] + ^ J do■dc^ , x(c 7 ) 5 ( 2 ) (c^,c^ / ;p !t ,)x((T , ) + o(iV x ) , (4.19) 

where S\ [p*] is given by the following expression: 

Si [p*] = | J da [{U(cr, a) - 1] p* (a) + J dada'p* (cr) [U(a, a') - l] 2 p* (a') . 

(4.20) 

The functional integral (4.9) at this order evaluates: 


-jj lo § i( z N) n ] av = S 0 [p*} + -^Si[p*] + ^ logdet (1 - T) + o(N x ) 

1 1 00 TrfT L l (4-21) 

= Sob.] + ^S.b„] - — £ -LJ + 0<JV-'), 

where the matrix T(a,a') reads 

T(a,cr') = z U(a,a')p^(a') - (^J drt/(a-,r)p*(r)^ p*(</) . (4.22) 

Using the RS parametrization (4.15), it turns out that in the limit n 0 the trace 
TV (V L ) can be arranged in a linear combination of free energies of closed and open 
chains. It all comes down to the fact that the term U(cr, a / )p^(a / ), present in T(a, a'), 
can be linked to the replicated transfer matrix of an edge receiving a cavity field at 
one of its extremities. In Appendix A.2 we prove the following formula: 


—Tr(T L ) = -/3z l [f L -L(f L - cft-i)] + 0(n ) , 


(4.23) 


where (j) C / a are free energies of closed and open spin chains in the graph of length 
L > 1, with (j>Q defined as </>$ = — /? - 1 E/ l log2cosh(/3/i). Writing the RS free energy 
density as: 

/RS = /S + V/" + o(jV-‘) , (4.24) 
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and observing that the term Si [p*]/N [viz. eq. (4.20)] cancels out with part of the 
first two terms in the sum Y^l=\ T r /(2 NL), the finite size correction of the 

RS free energy density /^g can be evaluated as: 




~ L {4>L - <t>°L- 1 ). 


(4.25) 

The sum entering the previous formula can be considered as a sum over indepen¬ 
dent loops weighted with the factor (jf L — L{<f>° L — cf >° L _,) , by noticing that, in the 

thermodynamic limit, z L /(2L) is exactly the average number of loops of length L in 
a Erdos-Renyi random graph of mean connectivity z. The same formula holds true 
also on the Erdos-Renyi ensemble C(1V, M), where M = zN /2 is the fixed number 
of edges, since the distribution of topological structures such as the number of finite 
loops remains the same at the 1/N order. 

In the limit of vanishing external field, eq.(4.25), evaluated in the paramagnetic 
phase, takes the following simpler form: 


oo r 
Z 


fSs = ^Ejlogch(^J) X E i J *i log 


1 +n tHPJi) 


i=1 


(4.26) 


where the first term takes into account the fact that the average number of links is 
z(N — l)/2 and the second one is the contribution of all the loops of length L > 3. 
The loops we are talking about are topologically defined as non-self-intersecting 
closed paths. Self-intersecting closed paths would give contributions proportional to 
N~ 2 , since the self-intersection is observed, on average, in a fraction N~ 2 of the total 
number of vertices. While eq. (4.25) is an original contribution to the literature, 
its zero field counterpart eq. (4.26) has been already presented [157]. Moreover the 
full distribution of /R' in the absence of external field and in the RS phase has 
been rigorously computed [158] an it is consistent with the mean value given by eq. 

(4.26). 


4.2.3 Computing the free energy density with cavity method 

We now show how to compute the finite size corrections to the free energy density 
using the cavity method. The reason to be interested in such a kind of calculation is 
twofold. Firstly we have to corroborate the physical insight gained from replicas; 
secondly we want to establish the equivalence of the two methods beyond the leading 
order, showing how both procedures give the same result also at order 1/N. 

The cavity method is well defined only in thermodynamic limit. In order to 
study 1/N corrections to the free energy density of a model defined on a Erdos-Renyi 
random graph (ERRG), we need to define a new ensemble of random graphs of J\f 
vertices, such that in the limit N —> oo any topological structure appears with the 
same density it has in the ERRG of N vertices. Here we are assuming that the free 
energy of a model of N variables can be written as F/y = Nf({di}), where f({di}) is 
the free energy density computed in the thermodynamic limit on a model having the 
same densities di of topological structures appearing in the finite N model. The new 
ensemble we are going to define is required to compute such a free energy density. 
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The topological structures we are interested in are the only ones that give 
contributions up to order O (1/JV), i.e linear chains of length L (i.e. with L edges 
and L + 1 vertices) and loops of length L. Let us start by computing their densities 
in a ERRG of N sites, where each link is present with probability z/N. The density 
of linear chains of size L (i.e. the number of linear chains per node) is 

^ = • (4 ' 27) 


and the density of loops of length L is 


d ‘r - jj 



l 

2 L 


N(N — 1)...(N-L + 1) ~ 


1 z L 
N2L ' 


(4.28) 


In the new ensemble a random graph of Af nodes can be viewed as the union 
of basic topological structures (BTS), that, for the present purposes, are chains 
and loops. The graph can be build in the following way. For each L > 1, consider 
all sequences of L + 1 different indices (ioAi, ...,il) with the condition iq < il, 
that avoids double counting of a chain; for each sequence of indices draw the 
edges (* 0 ) *i)> (*ij *2), • • ■, (*l-i,*l) with probability o,l/A[ l . Then, for each L > 3, 
consider all sequences of L different indices (ii, * 2 ,..., il) with the conditions that 
i\ is the smallest among the L indices and 12 < ii (these two conditions ensure 
that each loop is counted only once); for each sequence of indices draw the edges 
(*i,*2), (*2, * 3 ), • • • , (Ll—i,Ll), (iL,h) with probability c L /Af L ~ l . 

A useful representation of this graph is in terms of a factor graph, where the 
variable nodes are the graph nodes and the factor nodes are the BTS. Thanks to 
the scaling of the probabilities used in the building of the graph, the corresponding 
factor graph is sparse, since the total number of BTS (i.e., of factor nodes) is given 
by 


~ - 1)... (A r-L) a L “ AT(AT - 1) 

zL 2 A f L + ^ 

L =1 L =3 


.. (A f — L + 1) cl 
2L AT 1 - 1 


~ M 



and the coefficients and cl are constants. 

The sparsity of the factor graph ensures that the whole construction is consistent 
in the N —> 00 limit. Indeed the probability that any pair of graph nodes enters 
in more than one BTS is 0(1/AT). Since in the new ensemble we are interested 
in computing the free energy density to leading order, we can safely assume that 
any two graph nodes interact through at most one BTS; and this BTS uniquely 
determines whether the edge between the two graph nodes is present or not. 

The factor graph representation also allows us to write down the free energy 
density in a standard way by summing factor nodes and variable nodes contributions 


-I OO OO 

/ = 2 5Z a ^k + 2 51 + ^ site ’ (4.30) 

k =1 k =3 

where <\)° k and (f) k are respectively the free energies of chains and loops of length k 
and 

T 

4>site = Jj- “ n i) X w( a *) !°g Ai{vi) , 


(4.31) 
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with /Xj(uj) being the single spin marginal and n t the number of BTS where the 
variable i enters. 

We should now determine the values of the coefficients ak and Ck such that the 
densities of chains and loops in a typical graph of the new ensemble match those in 
eqs. (4.27) and (4.28) in the large Af limit. When computing the actual density of a 
given topological structure (e.g. a chain or a loop) one should consider that such a 
topological structure can coincide with a BTS, or be part of a BST or involve more 
than one BST. 

As a warm-up, let us compute the density of links (chains of length L = 1) in 
the limit Af —> oo: 


^chain 


v l Af 2 
iim —7 - 

A/*—>-oo J\f 2 


h * k h Nk ~ l 


1 

2 


Y ka k + Y c k 

.k=l k =3 


(4.32) 

where kJf k in the first sum and Jf k ~ 2 in the second sum are respectively the 
number of chains and loops of length k passing trough a given link, i.e., the number 
of possible BTS containing the two variables connected by a given link. 

When computing the density of topological structures made of more than one 
link, we need to consider that such structures can overlap with more than one BTS. 
In order to be concrete let us consider the density of chains of length L = 2: 

2 00 00 

k =2 k =3 


1 Af 3 

df ain = lim — r — 
Af —>00 Af 2 


/ 2d ckain ' 


(4.33) 

where 2df iain /Af = p\ is the probability of having a link 2 . The general expression 
for densities of linear chains of length L > 3 is the following 


^ichain 


, 1 Af L+1 

lim —:- 

J\f—>00 J\l 2 


Sl 


f 2df iain 


2 df“{ n \ 

) 


+E(*-i+1)^+ e ik 


k=L 


k=L +1 


Ck 

M L 


(4.34) 

where the function Sl gives the probability that the L consecutive links comes 
from more than one BTS and can be written (see Appendix A) in terms of the 
probabilities of having k(< L) consecutive links: pk = 2d// Lain /Af k . Since each term 
in function Sl is of order Af~ L , in the limit A->oowe have 


2d c L hain =Af L S L (pi,...,p L -i)+Y( k - L + 1 ) a k+ E c fc = 

k=L k=L +1 

S L (2di hain ,...,2di h “i n )+jr(k-L + l)a k + Y = zL 

k=L k=L +1 ^ ' 


(4.35) 


Note that eq.(4.35) is valid for any L > 1 since Si = 0 and C 2 = 0. 

A similar expression can be written for the densities of loops of length L. 

1 N L 


j loop i• 

d T = hm . r T 
A/ - —>00 Af 2 L 


Rl(P1, ■ ■ ■ ,PL- 1 ) + 


CL 

M L ~ l 


(4.36) 


2 In principle in pi there are already some contributions entering the sums, but this over-counting 
effect is irrelevant in the Af —> 00 limit. 
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where again the function Rj J represents the probability of generating a loop of size 
L by more than one BTS. Since the probability of having k consecutive links is 
0(Af~ k ) the function Rl is 0{N ~ L ) and then 


Joop = 


CL 
2 L 


1 z L 
N2L 



for L > 3 . 


(4.37) 


In other words, making a loop by randomly choosing smaller structures is more 
improbable than randomly generating directly such a loop. 

The detailed computation of the coefficients a*, from Eq. (4.35) is made in 
Appendix A. Here we just quote the result 


«i = z+ ~^(2z 2 - z ), (4.38) 

cil = y~ r (z L+1 — z L ) for L > 2 . (4.39) 


Plugging these coefficients in Eq. (4.30) we finally get 


z / 1 \ z 2 i °° Z L 

f = 2\~ NJ ^° + 2 \N ^° ~ ^ 2 ) + tv 2L ~ L ^° l ~ ^L-i)] + ^ site ' 

L—3 

(4.40) 

We observe that the sum on the r.h.s matches the sum over loops entering eq.(4.25). 
Moreover, if the term 4> S ite is expressed by means of cavity fields, one finds exactly 
eq.(4.25). This can be immediately seen in the case of zero external field in all the 
paramagnetic phase, where variables are unbiased and we have 4>site = —T{l — £) log 2 
with £ = z + (z 2 /2 — z)/N being the density of edges in the factor graph (i.e., the 
number of edges in the factor graph per variable node). Substituting this expression 
for (f> s it e in Eq. (4.40), simply gives: 


/ = -T(log2-|E J logch(/3J)) + ^TE J logch(/3J) 


oo L 
Z 


^ £ x E ( J .) log 

jL/ — O 


1 +n^) 


i=1 


(4.41) 


thus recovering the simplified replica result of Eq. (4.26). 

We can conclude that the replica calculation reproduces correctly all the topologi¬ 
cal structures involved in the 1/N corrections to the free energy density. Incidentally 
we note that self intersecting loops occur only with probability N~ 2 and they do 
not contribute to 1/IV corrections. 

Let us finish this section by giving a different interpretation to the present 
results. We have seen that under the assumption that finite size corrections can be 
computed by the cavity method in a graph with finite densities of certain topological 
structures, we have been able to reproduce the replica result (and give to it a more 
physical intuition). However, we could assume that replica and cavity methods 
should provide the correct free-energy for a very large, but finite, system, and then 
conclude that the free-energy of a model only depends on the densities of certain 
topological structures. This alternative view can be useful if one aims at computing 
the free-energy of a model defined on a finite dimensional lattice, by considering 
a lattice as a random graph with strong topological correlations, and making an 
expansion in these topological correlations (e.g., number of loops, but not only that). 
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4.2.4 Numerical Analysis 

In this Section we check the validity of our analytical expressions for the free energy 
corrections, eq. (4.25), against numerical simulations. Since from Monte Carlo 
simulations one obtains the energy of the systems, in order to avoid an integration 
in temperature we decided to work perform the simulations at zero temperature, 
where energy and free energy coincides. Moreover since eq. (4.25) holds for arbitrary 
disorder in the interaction and in the external field, we choose to keep the former 
deterministic and the latter randomly distributed. In this case in fact an exact 
polynomial algorithm is available to calculate the ground state. Therefore we apply 
eq. (4.25) to compute the finite size corrections to the energy density of the zero- 
temperature Random Field Ising Model (zt-RFIM) and compare with numerical 
simulations. The model is defined by the following Hamiltonian: 

n = -jY, CijfJiCTj - Y , (4.42) 

i,j i 

where the random magnetic fields are Gaussian random variables of zero mean and 
variance h'f = 1 and the ferromagnetic exchange coupling J take values in the interval 
[0, oo). The underlying graph topology is that of a Erdos-Renyi random graph. Due to 
the FKG [161] inequality the model does not undergo replica-symmetry-breaking [78] 
at any value of the ferromagnetic interaction strength J, so that our formulae for 
the finite size (free) energy density corrections remain valid also below the critical 
point, provided that a single pure state is selected. In the ferromagnetic phase the 
existence of two energy minima generates additional finite size fluctuations, which 
are proportional to N _1 / 2 . These kind of interstate fluctuations overcomes the 1/N 
intrastate contribution, which becomes practically invisible in numerical experiments. 
In this work we compare analytical predictions and numerical results only in the 
paramagnetic phase J < J c . 

The uniqueness of the ground state of the model allows to translate the formula 
(4.25) for the free energy density corrections into the corresponding expression for 
the ground state energy density corrections. We write the ground state energy 
density as the leading term plus the O (1/N) correction: 

e GS (N) = e§ s + ie<‘> + o (4) , (4.43) 


where reads: 


=(i) - 


e = — 


z — 




oo L 

z 


L 


[4-£(4-4-,)] • (4.44) 


The random variable h c is the cavity held, distributed according to the zero temper¬ 
ature solution of eq. (4.16), while e'Y are the energies of open and closed chains in 
the graph. The computational time cost of computing the energy density of a chain 
of size L by enumeration is exponentially increasing in N, therefore only partial 
sums up to L = 7 in eq. (4.44) have been considered in Figure 4.1. To accurately 
compute the whole L series, especially near the critical point, some assumptions has 
to be made about the large L behaviour of its term. Some of the authors have been 
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developing a formalism through which a spectral representation of the replicated 
transfer matrix [1] [138,145] can be obtained. Using this result the leading behaviour 

e L - L{e° L - e° L _ x ) ~ AL\ l (4.45) 


has been established for the zero temperature RFIM, which allows to analytically 
sum the remaining terms of the series (from L = 8 to infinity). The coefficient A is 
given by the first eigenvalue of the replicated transfer matrix and gives the decay rate 
of ferromagnetic correlation functions. It can be computed to high precision with 
population dynamics techniques or as the first eigenvalue of an integral operator. 
The coefficient A instead has been obtain from a fit of the first five point of the 
series. As an alternative approach assuming the validity of the AL\ l behaviour 
(which fares much better then a simple exponential decay assumptions) both A and 
A could be inferred from a fit of the first terms of the sum. The finite size corrections 
of the energy in the RFIM at zero temperature diverges as oc 1 _\ A , at odds with 
the double pole divergence eW oc which can be found at finite temperature. 

This matter has been elucidated in Chapter 3. 

At the critical point a scaling analysis of the correction can be performed. 
Calling r = \ J — J c \ the distance from the critical point, mean held theory [80] 
predicts the following finite size scaling for r and in the critical region: 


AT 1 / 3 ’ 

e (D=g(l)lVl/3, 


(4.46) 

(4.47) 


The leading correction to the thermodynamic ground state energy density is of order 
0(N ~ 2 / 3 ) in the whole critical region: 

e GS (JV) = ef +^‘>+o(^) for J -4 J c . (4.48) 

Furthermore eq. (4.43) is not valid in the ferromagnetic phase (for reasons mentioned 
in the beginning of this Section), where the leading correction happens to be of 
order 0(N~ 1 ^ 2 ): 

e as (JV) = e f+^e'W + o(^) for J > J c . (4.49) 

The numerical experiment is performed on a Erdos-Renyi random graph with average 
connectivity z = 4.We compute the ground state energy with the Minimum-cut 
algorithm [162,163], using the Lemon Library [107]. To draw the profiles of the 
energy density corrections in Figure 4.1 we took the average over 10 8 samples for each 
system size. In the same figure we compare the numerical data with the analytical 
prediction given by eq. (4.44) and check the finite size scaling relation given by 
equation (4.47). In Figure 4.2a we report the Binder cumulant: 



(4.50) 
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Fig. 4.1. Finite size corrections of the ground state energy density in the T = 0 RFIM on 
Erdos-Renyi random graphs with mean connectivity z = 4. In the upper panel we plot 
numerical data for different system sizes and the analytical formula given by eq. (4.44). 
Close to the critical point (which is J c ~ 0.395) the scaling of the energy corrections is 
given by the mean field prediction (4.47) as confirmed by the data collapse shown in 
the inset. In the lower panel we show the estimates of the formula (4.44), truncating 
the sum over loops with a cutoff L = 3,4,5, 6, 7 and extrapolating the whole series as 
explained in the main text. 

for system sizes ranging from N = 256 to N = 2048. From the intersection of the 
curves we identify the critical point, obtaining J c ~ 0.395(1). 

Figure 4.2b shows the behaviour of the averaged squared magnetization m 2 . The 
finite size scaling of m 2 in the critical region is given by the following scaling relation: 



(4.51) 


for r —> 0. 


This scaling form is confirmed by the data collapse shown in the inset of Figure 4.2b. 

4.3 Random Regular Graphs 

4.3.1 Replica formalism for random regular graphs 

Let us turn now to the computation of the first finite size correction to the free 
energy in RRGs. As usual the Hamiltonian is given by 



(4.52) 





















4.3 Random Regular Graphs 


73 



(a) Binder cumulant for the T = 0 RFIM on Erdos-Renyi 
random graphs with mean connectivity z = 4 for differ¬ 
ent system sizes as a function of the exchange interaction 
J. A vertical dashed line is drawn in correspondence of 
the critical point J c ~ 0.395. In the inset it is shown 
the data collapse in the critical region using the scaling 
variable (J — J C )IV 1//3 for the reduced interaction. 



j 


(b) Average squared magnetization for the T = 0 RFIM 
on Erdos-Renyi random graphs with mean connectivity 
z = 4 for different system sizes as a function of the 
exchange interaction J. In the inset it is shown the 
data collapse in the critical region using the scaling IV 3 
both for the reduced interaction and for the squared 
magnetization. 
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where the exchange couplings Jij and/or the local magnetic fields H{ are quenched 
independent random variables. The matrix Cij represent the entries of the adjacency 
matrix of a graph G extracted from the RRG ensemble. They take the values 
Cij = 1,0 depending on whether or not the vertices i and j are connected. Here 
we study c-RRGs, i.e., random graphs with vertices having uniform degree c. The 
probability measure of the c-RRG ensemble is uniform over all the regular graphs of 
degree c. 

To solve the model in the thermodynamic limit (i.e. N —> oo) and to obtain the 
finite size correction to this limit, we have to cast the averaged replicated partition 
function [Z n ] av into an integral form suited to steepest descent evaluation, as we 
did for ER ensemble. This procedure uses standard techniques [160,164-166] and is 
reported in detail in the Appendix B.l. Here we quote only the final result, which 
reads 

[Z n ] av = [det(d7)] 1/2 e' 4(JV ’ c) J Vp e ~ NS ^’ N \ (4.53) 


In the last equation the integral is performed over the space of all possible functions 
p(cr) = p(a i,..., <r n ) of a n-replicated spin, taking 2 n different values. The action 
S[p, AT] is a functional of p(a) and N, and at the leading order in N can be written 
as 


So[p] =| f dudr p(<j)U(<j,t)p(t) 

— log J du e B J d tU((t,t)p(t) 


(4.54) 


The action Sq will be optimized through the steepest-descent method. After 
that, we will integrate the Gaussian fluctuations around the optimal saddle point, 
thus obtaining the desired finite size corrections. The quantities U(<j,t) and B(a) 
appearing in Eq. (4.54) are defined by 


=E j 


exp 


n 

£■ 
a —1 


PJ Y (T a T a 


(4.55) 


and 


B(cr) = log 


exp 



(4.56) 


The explicit expression for the constant A(N, c ) appearing in Eq. (4.53) can be 
found in the Appendix B.l. 

Saddle point evaluation of 5o leads to the following self-consistence equation for 
the order parameter p: 


= e B ^ [/dcr / H(o-,cj / )^(cr / )] c 1 
/ d<7 // e B ( f7,, ) [/ dcr / t/(cj", a')p^(a')] c 


(4.57) 


Once a solution of Eq. (4.57) has been found, using Eq. (4.54) one gets the 
thermodynamic free energy density /o = linr/v->.oo /(IV). The difficulties of the 
problem are all hidden in the solution p*(a) of the saddle point equation. The 
function p*(cr) depends on the replicated spin (ci, • • •, cr n ), and hence, it is uniquely 
determined by the set of the 2 n possible values it can take. The most general solution 



4.3 Random Regular Graphs 


75 


should specify all these 2 n values. Here we limit ourselves to the simplest solution, 
i.e., the replica symmetric one. This solution has the property to be invariant under 
the group of permutations of the replica indexes, therefore p*(a) can depend only 
on the sum ^”=1 a a- The number of parameters necessary to fully specify a replica 
symmetric function is n + 1 (and hence much smaller than 2"). The most general 
replica symmetric parametrization of p*(cr) can be written in the form: 


P(?) 



e P h YZ=i a “ 

[2 cosh (/3h)] n ’ 


(4.58) 


where the function P(h) depends implicitly on n and is non-negative and normalized 
to one in the limit n —> 0. 

Inserting the parametrization (4.58) into the saddle point equation (4.57), and 
performing the limit n —> 0, we obtain a self consistent equation for the density 
P(h): 


P(h) = E j>h 


c -1 


H d h k P(h k ) 5 


k= 1 


c— 1 


h- H -^2 u(/3, J, h k ) 


k =1 


(4.59) 


where u(/3,x,y ) = /3~ 1 tanh _1 [tanh(/3x) tanh(/3y)]. We recognize Eq. (4.59) as the 
self-consistent equation for the probability distribution P(h) of the cavity field on 
a RRG of connectivity c. Solving the last equation for P(h) one can eventually 
evaluate the n = 0 limit of Eq. (4.54) and recover the thermodynamic free energy 
/o = liniAr^oo given by the Bethe free energy approximation [15]. 


4.3.2 Finite size corrections 

In this section we present the analytical expression of the first finite size corrections 
to the free energy density of disordered Ising models on the RRG ensemble. As we 
anticipated in the introduction, we assume the leading correction to the thermody¬ 
namical free energy density to be proportional to 1/N. Therefore, we split f(N) 
into the sum of the leading term plus the 1/N correction, that is 

./'(•V) ^ -"({.)• (4.60) 

The detailed calculation of the coefficient /i, the main result of this Section, is 
given in the Appendices B.2 and B.3. The derivation is based on the expansion of 
the contributions of the Gaussian fluctuations of the replicated action around the 
saddle point, given by 


- 2 lo £ det 


d 2 <g 0 

dp{a)dp{r) 



(4.61) 


as a power series containing the replicated transfer matrix of the system [138] [1]. 
The final result reads 


a = E 


1=3 


21 


(4.62) 
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W l * * w 



Fig. 4.3. Pictorial representation of the argument, given in Section 3.5, to compute the 
free energy shift due to the addition of a loop to a large tree graph. It is shown an 
open chain embedded in a tree graph (left), its removal from the tree ( center ) and the 
addition of a loop (right). 


The terms appearing in last equation and computed in the replica formalism have a 
clear physical meaning, as we will readily explain. We call A<f>g the quantity defined 
by 

A<f>t = <jfg — £ (f>. (4.63) 

where is the average free energy of a closed chain (loop) of length t embedded in 
the graph, that is 

# = ~[log Zj\ w (4.64) 

with 

yc _ „P{r\<T\+J\<j\<72-\ - \-rt<Tt+Jtcrecri) 

zA e • (4.65) 

01 vj Ot 

The cavity fields r* are i.i.d. random variables sampled from the distribution 


R(r) = E J)H 


c—2 


n d hk P(hk) <5 


k=1 


c—2 

r-H -^2 u(/3, J, hk) 

k =l 


(4.66) 


In other words, the cavity fields r t represent the effective fields coming from the 
rest of the graph on the nodes in a loop. The quantity <f> is the intensive average 
free energy of a closed chain with random couplings Jj, and random fields r*, i.e. 

f AC 

4> = lirn^oc -7T, and can be easily computed through cavity method [138] [1]. 

The fact that the fields r, are independently distributed and that they obey Eq. 
4.66, containing the fixed point distribution P(h), indicates that the contribution 
of each loop can be considered independently from the others. In fact the factor 
(c — ly/2i in Eq. (4.62) is exactly the average number of loops of length i in a 
RRG of connectivity c. Therefore, the coefficient f\ of the O (1/IV) correction can 
be expressed as a sum over all the loops in a graph, each one contributing with the 
amount A<j>g to the free energy. We call A <f>g a free energy shift since it is the free 
energy difference observes in a infinite tree after the addition of a single loop of size 
t, as we will argue in the next Section. 

It is yet to be investigated the relation between (4.62) for f\ and an analogous 
result that one could derive using the loop calculus formalism [167,168]. 

We notice that the loops considered here are defined as non-self intersecting 
closed paths. In fact, self-intersecting loops would give a contribution of order 
0(l/N 2 ) to the average free energy for simple combinatorial arguments. 


4.3.3 Probabilistic argument 

The computation of the 0(1/N) correction to the free energy in the RRG ensemble 
can be easily done through simple probabilistic arguments, as one realizes a posteriori 
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analysing the final result Eq. (4.62) obtained with the replica formalism. In fact, as 
already discussed at the end of the previous Section, at the 0(1/N) order loops are 
sparsely distributed in the graph and do not interact with each other. Therefore 
their contributions to the free energy can be summed up separately and each one of 
them can be considered as embedded in an infinite tree. In order to compute the 
free energy shift due to the presence of a loop of length £, we consider a very large 
random tree, with partition function Zt, and remove the £ + 1 edges of an open 
chain of length £ + 1, as showed in Figure 4.3. We call do, ..., cj£ + 1 the cavity spins 
of the new graph, that is the ones who lost one (this is the case of do and <j£+i) 
or two (di,..., cr?) of their adjacent edges. We call Z cav (ao, ..., d^+i) the partition 
function of this new system, conditioned on the values of the cavity spins. Since we 
assumed to start from a tree graph, the partition function Z cav takes the form 

Z cav (a 0 , ... ,d /+1 ) = Ze h ^ +r ^ + -+ r ^ +h ^+\ (4.67) 

where Z > 0 and the cavity fields hi and r 0 /^+i are independently distributed 
according to P(h ) from (4.59) and R(r) from Eq. (4.66) respectively. We recover 
the partition function of the original tree adding back the missing links, therefore 
we establish the relation 

Zt = Z x Z° t+X , (4.68) 

where Z^ +1 is the partition function of an open chain of length £ + 1 with incoming 
fields ho, r£, he+i. On the other hand, starting from the cavity graph, we can 

create another graph G containing exactly one loop. This can be achieved adding an 
edge between the spin do and &£+ 1 , and adding other £ edges to form a loop among 
the £ internal cavity spins (see Figure 4.3). Notice that with this construction all the 
spins retain the same degree that they had in the original graph T. The partition 
function of the system defined on G is then given by 

Z G = A x Z? x Zl (4.69) 

We are interested in the difference of the average free energy between the system G 
an T in the large graph limit. Let us call N the number of nodes in T and G. The 
free energy shift is then given by 

A</>£ = -4 linr [log Zq — log Zt\scv (4.70) 

p N—>oo 

For the average free energy (f>° L of an open chain of length L embedded in a RRG 
the following relation holds [1]: 


= L (j) + (p s , (4.71) 

where (p s is a site term that does not depend on L [1], It is therefore easy to derive 
the expected result: 

= <t>£ — £<j>. (4.72) 

We have proven that the free energy difference A <j>£ as defined by Eq. (4.70) 
corresponds to the quantity — £4>, as it was defined in the last Section. Taking 
into account that the average number of loops of length £ in a graph of the RRG 
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Fig. 4.4. Finite size corrections to the energy density of a spin glass model on a RRG with 
connectivity c = 4 and bimodal random couplings J = ±1. The various panels refer to 
different values of the external uniform magnetic field. The results obtained from Monte 
Carlo simulations are compared with the analytical values predicted from Eqs. (4.62) 
and (4.78). The vertical dashed lines mark the positions of the critical temperatures. 


t 

ensemble is || in the thermodynamic limit, we re-obtain Eq. (4.62) without making 
any resort to replicas. 

The argument we gave in this Section to compute the first finite size correction to 
the free energy is strictly limited to the RRG ensemble. In fact it relies heavily on the 
homogeneity of the graphs. On different graph ensembles more refined combinatorial 
arguments, as the one given in [2] for Erdos-Renyi random graphs, have to be used. 

4.3.4 Numerical Experiment: Spin Glass in a Magnetic Field 

In this Section we test our analytical prediction for the finite size correction to 
the free energy, Eq. (4.62), on the spin glass in a uniform magnetic field. The 
connectivity of the graph is c = 4. In the experiment the couplings Jij are bimodal 
random variables, taking value Jij = ±1 with equal probability. We simulate the 
model using a parallel tempering Monte Carlo algorithm and three different values 
of the external field H = 0.3, 0.5 and 0.7. For each value of the magnetic field H we 
simulate systems of three different sizes: N = 2 6 ,2 8 and 2 10 . 

In order to compute the analytical estimate of f\ we proceed in two steps: we 
explicitly calculate the first terms of the sum. We computed by transfer matrix 
multiplication the partition function and the free energy of closed chain of length 
£, for many realizations of the disorder and up to £ = 7. We then resummed the 
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remaining terms of the series using the criterion explained in Ref. [2], that we briefly 
recap. Using the formalism of the replicated transfer matrix developed in Ref. [1], 
one can show that, in a spin glass, the dominant contribution to f\ comes from 
the replicon eigenvalue. Therefore, we use only the knowledge of this eigenvalue to 
analytically resum the remaining terms of the series (from £ = 8 to oo). The large £ 
behaviour of the shift A <j>g is given by the expression 

A fa ~ AX t for £ 3> 1, (4.73) 

where A is the replicon eigenvalue, the largest eigenvalue satisfying the following 
integral equation: 

\g\{u) = E Jir j d u 1 gx(u')5[u - u(/3J,r + v!)\ ■ (4.74) 

Here r is distributed as !?(?’) defined in Eq. (4.66). The maximum eigenvalue of 
the integral operator in last equation can be obtained numerically by population 
dynamics techniques. The coefficient A instead can be computed analytically, as 
shown in Ref. [1], and takes value A = 3/(2/?). We can split the quantity f± in two 
pieces: 

h ~ S(L) - ^£og i+1 [1 - (c - 1) A] , (4.75) 

where S(L) is the partial sum over the loops up to £ = L, and the second term is the 
resummation of the remaining series from £ = L + 1 to £ = oo, which we represented 
via the function £og p (l — x), defined as: 

OO £ 

£og p (l -x) = ( 4 - 76 ) 

£=p ^ 

In our concrete case we can compute explicitly the first L = 7 terms of the series, 
and so, the approximated analytic form of f± is 

/i ~ 5(7) - ^£og 8 [1 - 3A] for c = 4. (4.77) 

In a numerical simulation, measuring the energy is, actually, much simpler than 
the free energy (since the last one involves an estimate of the entropy). As a 
consequence we preferred to compare analytical and numerical results for the finite 
size corrections to the energy density e\. Analytically , the quantity ei is given by 
the usual formula relating energy and free energy: 

ei = fl + p W' (4 ' 78) 

In Figure 4.4 we show the comparison between the experiments and our theoretical 
result. The agreement is good at high temperatures, while it deteriorates close to 
the critical point. At the critical point in fact every order of the 0(1/N) expansion 
of the free energy diverges, therefore near the critical point subleading finite size 
corrections become increasingly important and extrapolation of ei obtained from 
numerical simulations to its large N limit, that can be derived by our analytical 
expression (4.62), is difficult to achieve. 
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4.4 Conclusions 

In this Chapter we performed a thorough analysis of the O (1 /N) correction to the 
free energy density in disordered Ising models defined on Erdos-Renyi and random 
regular graphs. We derived an analytical formula which can be easily used to quantify 
finite size effects, avoiding the subtleties associated with the diagonalization of the 
Hessian. We also checked the correctness of our results through a numerical study 
of the RFIM at zero temperature in the ER case and of a a spin glass at finite 
temperature in the RRG case. In both case we found excellent agreement with the 
analytic prediction. Using this formalism though we could not compute the finite 
size corrections in the ferromagnetic ordered phase of the RFIM. In this phase in fact 
the 0(1/N) correction is overshadowed by a O correction. This anomalous 

correction will be addressed analytically in Chapter 5. 

A much more serious problem arises in the glassy phase of thespin glass model, 
where exponentially many pure states are involved. The leading finite size correction 
are much bigger than 0(1/N), in fact numerical results for the ground state of 
spin glasses on RRGs suggest that they are order O 3 j or O (^N~ b 'j , depending 
(surprisingly) on the bond distribution [124]. The question if our formalism can be 
adapted to cover the fullRSB case remains open. 

In the ER ensemble we showed how replica results for the 1 /N corrections to 
the free energy density can be derived also in the cavity formalism, resorting to an 
auxiliary graph ensemble which in some sense lifts the O (1/IV) contributions to the 
leading order. It would be interesting to see if this combinatorial derivation could 
be transposed to other graph ensembles. 

Our results seems to hold some degree of universality, in fact the free energy 
contribution from simple loops at the order 0(1/N), can expressed in both ensembles 
as 

A&, (4.79) 

e>3 

where is the mean number of simple loops of length l, and A fa is the free energy 
shift due to the addition of a loop to an infinite tree, defined as 


A& = #-*(#-#_i). (4.80) 

Moreover using the replicated transfer matrix formalism of the previous Chapter we 
can approximate A (f>e, with the leading eigenvalue and corresponding coefficients of 
the Longitudinal or the Replicon sector, with good accuracy even for small l. We 
will show in Chapter 8 how to make use of these results to compute the first order 
term in the perturbation theory around the Bethe free energy for finite dimensional 
systems. It is given also in that case by Eq. (4.79), with only a simple redefinition 
of the coefficients A fg. 
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In the last Chapter we computed the first finite size correction to the free 
energy in diluted random graphs. The computation was done in a (replicated) 
field theoretical frameworks, examining the Gaussian fluctuation around the 
saddle point. Eventually higher order terms in the 1 /N can be computed in this 
framework by standard perturbation theory, and all the terms in this expansion 
would have a direct topological interpretation in terms of free energy shifts due 
to the presence of loopy structures in the graph. 

In same cases though, when there are other competing sources of finite size 
corrections or multiplicity of saddle points, this approach fails to capture the 
most relevant contributions. Problem specific techniques have to be devised 
to deal with them. Here we examine two such cases, where leading finite size 
correction are ultimately due to non-perturbative effects. 

The first case is the RFIM in the ferromagnetic phase, that, as we mentioned in 
last Chapter, presents 0(1/y/N) corrections to the free energy. This phenomena 
is present both mean field and finite dimensional systems. We set up a formalism 
based on replica theory in order to compute such corrections. While the 
approach is general to any random field model, only in mean field topologies 
the computations can be carried on exactly. 

In the second part of the Chapter we investigate the scaling behaviour of the 
average cost in the Euclidean Assignment Problem. We show how the difference 
in the number of blue and red points in a small region of space is a source for 
the transport field. This is formalized in a Poisson-like equations that yields a 
surprisingly ample set of predictions for the leading and subleading behaviour 
and coefficients of the average cost for each dimension d. 
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Chapter 5 

The Random Field Ising Model 


5.1 Introduction 

We consider for concreteness a system of N Ising spins, o t = ±1, and external 
random fields. The following arguments though apply to a general class of models 
possessing O(m) symmetry (once the average over disorder is taken). On a given 
graph G, the Hamiltonian of the RFIM is 

N 

'H = -J ^2 a i a 3 - hi (5-1) 

(i,j) i=1 

where the first sum is over adjacent spins, J > 0 is a ferromagnetic coupling and the 
the fields hi are quenched i.i.d. random variables with zero mean and unit variance, 
i.e. E[/q] = 0 and E [hi hj\ = Sij. 

It takes a simple argument to show that, at least at zero temperature and for 
J large enough, the subleading term in N to the average energy E(N ) is of order 
OiVN). In fact in this case, for a given realization of the external fields {hi}, 
the Gibbs measure is concentrated on the configuration with minimum energy, the 
candidates being the one with all the spins up and the one with all the spins down. 
For a given graph with M = 0(N ) edges, the energies of the two states, let us call 
them E + and are E_ respectively, are given by 

N 

E± = —MJ =F ^ hi for J> 1. (5-2) 

i =1 

The sum in the r.h.s. is a random variable of variance N, converging to a Gaussian 
variable in the thermodynamic limit. Therefore it is easy to see that for the average 
energy E(N) = E[min(H + , E_)\ we have 

E{N) = -MJ - ^VN+ o(Vn) for J> 1. (5.3) 

It turns out that the y/N subleading behaviour we found in this limit case is present 
in the whole ferromagnetic region in the J — T (coupling-temperature) plane. 

In fact in the ferromagnetic phase the statistical weight is concentrated on 
two disconnected regions of the configuration space, having positive and negative 
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magnetization respectively, separated by a free energy barrier exponentially increasing 
in N. While the two regions are completely equivalent in the pure ferromagnetic 
system, once the disordered external held is turned on their free energies start to 
differ of a random quantity of order 0(y/N). The total free energy of the system is 
then simply given by the minimum among the two, except for some exponentially 
decaying terms. Let us first define, for a given realization of the disorder, the 
free-energies F + and F- as the ones corresponding to configurations having positive 
and negative magnetization respectively (for simplicity we assume N to be odd). We 
assume, and verify a posteriori for the RFIM, that in the ferromagnetic phase the 
difference between the free energies of the two states, F + — F_, is of order 0(y/~N). 
Then the average free energy of the system is given by 


F(N) 




E[min(F + , F_)] + exp. vanish. 


terms. 


(5.4) 


From these premises it follows simply that the average free energy has an 
expansion in N of the form 


F(N) = f 0 N + f 1 VN + o(VN), 
where the coefficients /o and /i of the expansion are defined by 

fo = lim — E [ F + ] = lim — E [ F_ 1, 

J iv— »+oo TV L J N^+oo N L J 


fi = , lim 


-1 E[|F+ - F_| 


(5.5) 


(5.6) 


(5.7) 


N— H-oo 2 

To compute fi we extend a method developed in Refs. [169] and [170-172], At fixed 
N and for a given realization of the disorder, let us call Z+ and , the partition 
function constrained to the configurations with positive and negative magnetization. 
Considering n and m replicated systems respectively, one can easily see that for 
small n and m we have 


-ilogE [Z%2^\ 


n 


?rE[F + ] + mE[F_] —^-/3Var(F+) 


(5.8) 


m 


- —/3 Var(i7_) — rimfi Covar(F + , FJ). 


Obviously, for symmetry reasons, E[F+] = E[FL] and Var[F+] = Var[i7_]. The free 
energies F + and FL are jointly distributed random variables. If the limit 


A2 = J im bAf[ Var ( i? +) “ Covar(F+,F_)] 
N^-oo ZiV 

= lim -4-E [(F+-F_) 2 ] 

N^-oo 4N 


(5.9) 


is non-zero, the rescaled variables /+ and /_, defined by 


= F± ~ foN 

Vn 


(5.10) 
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become non-trivially jointly distributed Gaussian random variables for large N. In 
fact, while higher orders cumulants in the n and m expansion of Eq. (5.8) are of 
order O(N), with this rescaling they give vanishing contributions. 

Since asymptotically is itself a Gaussian random variable of zero mean 

and variance A 2 , it follows that the coefficient fi of Eqs. (5.5) and (5.7) is given by 


fi 


dz 

V2ttA 2 


\z e 2 a 2 



(5.11) 


The computation of the n and m expansions in Eq. (5.8) can be performed using 
the standard replica techniques. Since it is impractical to work with the partial 
partition functions Z + and Z_, we define the partition function Zu of the system 
having an additional deterministic external field H acting on all the spins. Then we 
define the replicated free energy (j){n, m) as 

(j)(n, m) = lim linr — —log E[ Z\ Z ^ H \. (5.12) 

H— 5>0+ N^foo piV 

This definition is completely consistent with the l.h.s. of Eq. (5.8) in the ferromag¬ 
netic region, and is even more physically sound in the paramagnetic region, allowing 
to treat with a unified formalism the whole phase space. 

We compute </>(n, m) for integer values of n and m using the saddle point 
technique for N — > oo. Then we make an analytic continuation of the solution to 
real value of n and m. By definition (5.12) the 0 — th order term of the expansion is 
zero. Since we are interested only in the quadratic terms of the m) expansion, 
and since the (f>(n, m ) is variational in some order parameter, our calculations will 
involve only the order parameter computed at n = m = 0 and we do not have to 
consider its n and m dependence. As always happens with calculations involving 
replicas, the exchange of the n and N limits will be done without particular care. 

In the following Sections we will explicitly compute <j>(n,m) given by Eq. (5.12) 
in two mean field models. 


5.2 Fully connected 

The first case we consider is that of the RFIM on the fully connected graph. Here 
the first sum in the Hamiltonian (5.1) runs over N(N — l)/2 edges, and the coupling 
J has to be rescaled by a factor A -1 in order to obtain an extensive thermodynamic 
behaviour. It is then easy to compute the replicated free energy of the system, 
defined in Eq. (5.12), through standard Hubbard-Stratonovich transformation is 
given by 


<t>Fc{ni m ) = m in { - J(n + m) x 2 

x>o (2 


—- log Eh (2 cosh f}(Jx + /i)) n (2cosh/3 (—Jx + h)Y 


(5.13) 


Notice that the order parameter x, the magnetization of the up-state, enters in the 
last term of Eq. (5.13) both with a plus and a minus sign. As a technical note, in Eq. 
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(5.13) the minimization condition does not ever turn to a maximization when the 
number of replicas is small, as it happens in glassy models [13], since the dimension 
of the order parameter in the full replica space is n + m and is always greater than 
zero in our calculations. 

To obtain the 0(y/~N) contribution to the free energy we have to compute the 
small and n and m expansion of <f>Fc{n,m). As already discussed at the end of the 
previous section, only the n = m = 0 saddle point solution, given by the non-negative 
solution of 

x = Eh tanh (3( Jx + h), (5-14) 

appears in the second order expansion of the replicated action. Therefore the 
coefficient A, defined in Eq. (5.9) and characterizing the 0(y/~N) correction though 
(5.11), is given by 

a fc = ^1% [(log cosh P(Jx + h )) 2 ] ^ 

— Eh [log cosh j3(Jx + h ) log cosh f3(Jx — h)]}. 

Last expression can be easily computed for any value of J and /?. In order to 
compare the analytic prediction with exact results, it is easier to consider the zero 
temperature limit of (5.15). This is given by 


]im o A Fc= \^h(\Jx + h\ - \Jx-h \) 2 


with x non-negative solution of 


x = Eh sign( Jx + h). 


(5.16) 


(5.17) 


We focus on the zero temperature limit for two reason: the zero temperature fixed 
point is the one controlling the flow of the renormalization group also starting from 
finite temperature [53]; the ground state of the RFIM can be computed efficiently 
using exact numerical algorithms. 

We implemented an exact and very efficient algorithm to compute the ground 
state of a fully connected RFIM, that takes advantage of the topological equivalence 
of all the spins. In fact it is easy to realize that among all the configurations having 
a certain total magnetization M = the one with lowest energy is the one 

where only the first N spins with the lowest external field are down. 

Therefore, once the spins are sorted according to their external fields (an operation 
of time complexity 0(A log A)), we have to look only to these A + 1 configurations 
characterized by M = —N,—N + 2to find the ground state (an ©(A) 
operation). We have thus produced an algorithm of time complexity 0(IVlogA) 
and with 0(A) memory requirements. This is a great improvement over the min-cut 
algorithm that we used on diluted graphs (as we shall explain in next Section), 
that has time and memory complexity ©(A 3 ) for fully connected graphs. With this 
algorithm we where able to perform highly precise averages of systems up to 10 6 
spins. We then subtract the leading order (in A) term /qA, that can be computed 
exactly, to obtain the numeric estimate of the coefficient f\ up to subleading finite 
size effects. In Fig. 5.1 we show the perfect agreement between the results of our 
exact algorithm and the analytic prediction f± = — Ay^, with A given by Eq. 
(5.16), for the RFIM at T = 0. 
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Fig. 5.1. The numerical estimates, obtained through the algorithm described in the text, 
of the coefficient of the 0(y/~N) correction to the average free energy in the RFIM at 
zero temperature on the Fully Connected Graph, for many sizes of the system (orange 
lines). The numerical curves extrapolate to the analytical prediction of Eqs. (5.11) and 

(5.16) for large N (black line). The dashed black line is the asymptotic value vM. 
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5.3 Random regular graphs 

The analytic computation of the 0(y/~N) correction to the average free energy in 
diluted models is slightly more involved. Here we focus on the random regular graph 
(RRG) ensemble. Each element of the ensemble is chosen uniformly at random 
among all the graphs where each node has fixed connectivity z, The RRG and other 
diluted graph ensembles have the property of being locally tree-like, in the sense 
that each finite neighborhood of a randomly chosen node is with high probability 
a tree in the large N limit, and the density of finite loops goes to zero [15]. This 
property allows for the analytical tractation of such models, at list at the leading 
order in N. 

Following the lead of Ref. [172], we apply the replica technique to Eq. (5.12), to 
obtain the replicated free energy 


where 


and 


4>RRG{n,m) = ndn j ^ 4>edge[p\ (l>site[p] }, 

(5.18) 

<t)edge[p\ = log E W)/l2 ^ l) 


<71^2 

(5.19) 

X e^ 1 + J Ea CT 1 ff 2+^2 £ a <$) p^ 1 (<J 2 j 


= log K •£ e® E : ; “'’V Ml 

(5.20) 


a 


A similar expression, for the replicated free energy of spin glasses on RRG, was 
derived in Ref. [173] (see also Eq. (7) of Ref. [174] for a more general formulation) 
and relies on the hypothesis that the graph contains few short loops. 

Eq. (5.18) is a straightforward generalization of these results, the difference 
being that the replicas are divided into two blocks of size n and m respectively. 
The minimization condition in Eq. (5.18) is imposed over all the functions p(a) = 
pic 1 ,..., a n+m ) of a n + m replicated Ising spin, taking particular attention to 
constrain the first n and last m replicas to be in the up and down state respectively. 
Here as in the fully connected case, the dimension of the order parameter, 2 n+m , is 
always positive, and we do not incur in the usual peculiarity of replica calculations, 
the exchange between minimum and maximum conditions. 

Under replica symmetry assumptions the order parameter p(a) can be parametrized 
in the form 


p{cr) = 


d P(u + ,u ) 


p{ u + y n , a°-+u- y m ±1 <j a ) 

oZ—/a=l Z—/a=n+1 ' 


(2 cosh j3u + ) n {2 cosh (3u~ 

In the small n and m limit the minimum condition gives 

. z —1 


(5.21) 


P{u + ,u ) = E h J\[dP{u^,u k ) 5^u + - g{h + J2 u k)j 5 { u ~ 9{h+J2 u k)J> 

k == 1 k k 

(5.22) 
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where the function g(x ) is the usual cavity iteration rule g(x) = | atanh(tanh(/3 J) tanh(/3x')). 
The vanishing auxiliary external field H of Eq. (5.12) selects the solution of Eq. 

(5.22), supposed to be unique, such that u + > 0 > u~ (denoting with • the expecta¬ 
tion over P{u + , u - )). 

Expanding the replicated free energy 4>RRG{n, m ) to the second order in n and 
m we can than derive the 0(\/N) coefficient of the free energy according to Eqs. 

(5.8) and (5.11). We note that only the fixed point distribution P(u + ,u~) computed 
at n = m = 0, that is the solution of (5.22), contributes to the quadratic order of 
<f)(n,m). The coefficient A appearing in fi = than reads 


A RRG ~ ^2(2 ( E [^+l ~~ ^[^+" 4 -]) 

-(z-l)(E[Bl]-E[B + B_])y 


(5.23) 


The terms A± and B± stem from the edge and site replicated free energies (4> S ite 
and 4> e dge) respectively. The expectations E[«] are over both the distribution of the 
external random field and of the cavity fields. The site terms B + and are defined 
by 


2 cosh (3{h + u± ) 
Uk =1 2 cosh Pu% 


(5.24) 


Here the fields u ^ and u \7 are distributed according to P(ujt~, it)"), solution of Eq. 

(5.22), and h is distributed as the external random fields. The edge terms A + and 
A-, appearing in Eq. (5.23), are defined by 


A± = log 

0~1,CT2 


exp/3(hfai + Ja\a- 2 + hf(r - 2 ) 
IIfc=i 4 cosh /3uf k cosh 


(5.25) 


The random held is distributed as h + J2k =1 u fk > w bere h is an external random 
helds, and analogous definitions follows for the other cavity fields. 

We notice that only in the terms E[H + H_] and E [B + BJ\ of Eq. (5.23) the full 
joint distribution P(u + ,u~) is needed, not only its marginals. 

The computation of A 2 , and therefore of the analytic finite size correction /j, to a 
high level of precision through Eq. (5.23), is a computationally easy task. We solved 
numerically the fixed point condition Eq. (5.22) through a population dynamic 
algorithm. In this case each element of the population is a couple of cavity messages, 
u + and u ~, each of them encountering the same external random helds h during the 
iterations of the algorithm. As initial condition, in each couple the message u + is 
set to a high positive value, while the message u~ is set to a low negative value. 

In the paramagnetic phase the stable solution of Eq. (5.22) takes the trivial 
form P(u + ,u~) = P(u + )5(u + — u ~). The 0(\fN) finite size correction is thus zero. 
In the ferromagnetic phase instead, the messages u + and u~ become non-trivially 
correlated. 

We computed with the population dynamics algorithm the solution of the hxed 
point Eq. (5.22) at temperature T = 0, for many values of the coupling J and for 
connectivity z = A. The expectations we hnd in the expression of A 2 given Eq. 

(5.23) are then computed sampling from the population. 
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As in the case of the fully connected model, it is easier to verify the analytic 
predictions working at zero temperature, since the free energy and the energy coin¬ 
cides and the ground state of the system can be obtained through exact polynomial 
algorithms. 

Therefore the analytical result is compared with an exact numerical algorithm that 
exploit the equivalence between the problem of finding the ground state of the RFIM 
on an arbitrary graph and the minimum cut optimization problem [109]. We used the 
implementation of the Goldberg-Tarjan’s preflow push-relabel algorithm provided by 
the open source Lemon Graph Library [107], whose worst case complexity is ©(iVa) 
for instances of the RRG ensemble. The numerical estimate of the 0(y/~N) coefficient 
is obtained from a linear combinations of the free energy of systems of different sizes, 
and it is given by 

E[F(2JV) - 2 F(N)] 

cVN 

with c = ^ — 1. The value of f\ (TV), obtained averaging the minimum cut results 
over many samples of the system, should converge for large N to the analytical 
value computed trough the population dynamic algorithm applied to Eq. (5.23). 
The data plotted in Fig. 5.2 show a very good agreement between experiments 
and predictions, although the convergence is slow due to the presence of subleading 
=) finite size effects. 

5.4 Conclusions 

We argued for the existence of an anomalous 0(y/N) subleading correction to the 
thermodynamic average free energy /o of systems with a zero-mean external random 
held. This correction is limited to the ferromagnetic phase, since it is caused by 
the difference of free energy among the two pure states. If one is interested only in 
asymptotic quantities such as /o , the slowing down of the convergence can be avoided 
in numerical simulations such as Markov Chain Monte Carlo methods choosing an 
initial condition uncorrelated to the realization of the disorder (as is indeed usually 
done), such that the dynamics gets trapped with equal probability in the state with 
lowest free energy or in the other one. Estimations of observables on systems of 
finite size through exact algorithms though are bound to follow a behaviour of the 
type a(N) ~ ao+ ^=, therefore the convergence is much slower then the usual O(yr) 
behaviour one finds in the paramagnetic phase or in pure systems. On the other 
hand when the focus is on the finite size average value of some observable, particular 
care has to be taken for the definition used for the finite size free energy and for the 
method chosen to equilibrate the system. 

Using a formalism inspired by some recent works [169] [170-172] we present a 
general framework to compute the coefficient f\ of the 0(v/iV) term in the average 
free energy. The computation has been carried out, using a variant of the replica 
trick, in two solvable mean held systems, the RFIM on the fully connected graph 
and on the RRG ensemble. The analytic results obtained, Eqs. (5.11)(5.15)(5.23), 
are found to be in strong agreement with the numerical simulations. 

A different but equivalent approach to the problem, also based on the replica 
trick, can be taken using the techniques of Refs. [175,176]. Instead of computing the 
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Fig. 5.2. The numerical estimates, obtained through the min-cut algorithm, of the 
coefficient of the 0(y/N) correction to the average free energy in the RFIM at zero 
temperature on Random Regular Graphs of connectivity 2 = 4, for many sizes of 
the systems (orange lines). The numerical curves (see Eq. 5.26 for their definition) 
extrapolate to the analytical prediction of Eqs. (5.11) and (5.23) for large N (black line). 

The dashed black line is the asymptotic value \ -■ 
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large deviation function <j)(n,m), where n and m replicas are constrained to be in 
the up and down state respectively, and expanding to small values of n and m, the 
same conclusions could be obtained summing over all the saddle point contributions 
obtained from the partitioning of a the replicas in the two sets. We preferred 
the approach of Refs. [169] [170-172] because it is conceptually more clear and 
analytically less involving (although they share many similarities). 

While the formalism we have developed in Section 5.1 is completely general, the 
exact computation of the coefficient A 2 (thus of f\) can be achieved only in mean 
held models. In finite dimension one has to resort to a perturbative diagrammatic 
expansion of a replicated held theory. We did not take this path, but our numerical 
simulations with a min-cut algorithm, using the same procedure described in Section 
5.3 for the RRG ensemble, show, qualitatively and also quantitatively, the scenario 
depicted in Fig. 5.2. Summing it up, as a general feature of models with zero-mean 
random external held, the average free energy density as a hrst finite size correction 
of order (){jj) in the paramagnetic phase, and of order 0(^=) in the ferromagnetic 
phase. 
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Chapter 6 

The Euclidean Assignment 
Problem 

6.1 Introduction and Main Results 

In this Section we focus on a restricted version of the matching problem, the complete 
bipartite matching problem, also known as the assignment problem, that has a long 
standing tradition among the scholars [15,18,84], In this problem we have two sets 
having the same cardinality N, let us call them 7 Z and B, and we want to find a 
one-to-one correspondence between the elements of 1Z and the elements of B in such 
a way that all the elements are paired and a certain global function of this matching 
(called the cost function) is minimized. An instance of the assignment problem is 
a N x N matrix w: each element Wij gives the partial cost of the assignment of 
the element i € B to the element j & 1Z. From a combinatorial point of view, an 
assignment is a permutation ir £ Sn, where Sn is the set of permutations of N 
elements. Its cost is defined by 

1 N 

E n [tt,w\ = — X! *%!■(*) 

i =1 

The optimization problem consists in finding the optimal assignment n*, i.e., the 
assignment 7r* that satisfies the property E^[tt*,w] = rnin^gs^ En[it;w]. 

Some interesting questions arise when random instances of the problem are 
considered, that is, when the elements of the cost matrix w are chosen accordingly to 
a certain probability law. We will discuss the properties of the system for different 
choices of the disorder, i.e., of the distribution of w. Let us consider the average 
optimal cost Ejy = En[tt*-, w), where T denotes the expectation over the instances 
w of the problem. If we choose the problem ensemble such that the matrix elements 
are i.i.d. random variables, we obtain the so-called random assignment problem. 
This version of the problem was largely investigated in a set of papers in which 
both the distribution of the optimal weights in the large N limit [18,104] and 
the finite sizes corrections [95] were derived using different approaches. In this 
context, the celebrated replica approach, directly borrowed from the theory of spin 
glasses and disordered systems, proved to be an excellent tool to investigate the 
properties of these random optimization problems, and led to the celebrated formula 


( 6 . 1 ) 
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2 

liniTv^oo Efj = \ under certain assumptions over the distribution of Wij [18]. Quite 
interestingly the average optimal cost En for the random assignment problem is 
known exactly for every value of N. It is given by the simple formula En = Ylk =l 
as has been first conjectured in [177] and independently proven in [105] and [178]. 

From an analytical point of view, a much more difficult problem arises when the 
elements of the cost matrix w are correlated. This is indeed the case of the Euclidean 
assignment problem , also known as Euclidean bipartite matching problem (Ebmp). 
The Ebmp is an assignment problem in which a set of N “blue” points B = {bj}^ 1 
and a set of N “red” points 7 Z = {r*}^ 1 are given on the hypercube [0, Y d . Each 
point is supposed to be generated independently and uniformly at random in the 
hypercube. Periodic boundary conditions are imposed (in other words, to avoid 
scaling corrections due to border effects, we consider the sets of points on the torus 
J d = R d /Z d ). The cost of the matching between two points is then given by a 
function of their distance on the torus. We will generalize the Euclidean flat distance 
on the torus to a family of functions characterized by a cost exponent p, assuming 
that 

= ||bj - Tj\\ p , (6.2) 


where ||bj — r j || = 


\JtLi (min{| ~b\ 


— r" 


, 1 - 


- 


})' 


is the Euclidean norm 


on the torus. Due to the underlying Euclidean structure, the elements of w present 
very strong correlations. We shall denote with E^\d) the average cost of the optimal 
assignment between N red points and N blue points on T rf with cost exponent p, 
that is 


E^\d) = E^^-ir^bi}], 


(6.3) 


where the average is intended over the positions of the points and n* is the optimal 
permutation. In the following we will sometimes drop the dependence on p and on d 
of the optimal cost, and write simply Ej\f. 

The scaling behaviour of the leading order of the optimal cost is well known 
for p > 1 and all values of d and has been confirmed also by the investigations 
conducted by means of statistical physics methods. In fact, from a simple heuristic 
argument [58], we expect that, given a red point, the nearest blue points can be 
found approximately in a volume of order O around it: their distances from the 

red point is, for this reason, of order N~d. Supposing that each red point is matched 
to one of its nearest blue points, the expected total cost scales as E^ = O (^N~d^j 
for large N. It turns out that this asymptotic estimation is correct only for d > 3 
as it can be rigorously proved [179]. In a fundamental paper on this subject, 
published in 1984, [180] proved that for d = 2 a logarithmic correction appears, 

Eat = O 2 ^j ■ I n dimension d = 1 instead, the divergence from the expected 

result is even greater, in fact it is informally known to the literature [96,180] (even 
if to our knowledge nowhere formally stated), that E^ = O [n~ 2 ^ in this case. We 
can resume the state of the art of knowledge regarding the asymptotic behaviour of 
the average optimal cost in the Ebmp, with the following formula: 
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E%\d) 

N~d 


(0{N2) d= 1, 

io ((log IV)I) d= 2, 
+ 0(iV-^) d> 2. 


(6.4) 


The determination of the exponents 7 ^ is one of the original contributions we present 
in this Section and it will be discussed in the following. The coefficients e^' are not 
known to the literature and could not be derived using our approach either, even 
though we give accurate numerical estimates in Table 6.2. The rescaled average 
optimal cost, /3^\d), is what a physicist would call the intensive energy, and will be 
used in the rest of the Section. As with Ejy, we will sometimes drop the p and d 
dependence from it and write simply /3jv- 

The scenario depicted in Eq. (6.4) has to be compared with the one arising in 
the Euclidean monopartite matching problem (Emmp). [58] studied analytically this 
problem considering the correlations among the costs as perturbations around the 
case with random independent entries Wij. In the Emmp there is a unique set of 
2 N points to be matched among themselves. It has been proven [181,182] that, 
in the Emmp, the rescaled average optimal cost f3^\d) has a finite limit and is a 
self-averaging quantity in every dimension d. The odd behaviour noticed in the 
bipartite case in low dimensions is due to the presence of differences, in small regions 
of space, between the number of red and blue points, that imply the presence of 
“long distance” pairings and the failure of arguments based on subadditivity [59]. 
Obviously, in the monoportite cases such problems do not exist, since a partial 
matching between the points in an arbitrary subregion of [ 0 , l] d leaves only one point 
at most unpaired. 

Moreover numeric and analytic arguments [59] show that in the Emmp the first 
subleading correction to the large N limit of /3n is of order 0(N ~ 1 ) in any dimension. 
This assumptions though was also been improperly used in the Ebmp to numerically 
extrapolate the value e ^ = liniTv^-oo Pn\^) for d > 2 in the case of flat distances [59] 
(i.e. p = 1). This led to some inaccurate estimations of that we address in Table 
6.2. In fact in Section 6.3 we give numerical evidence that the appropriate value for 
the exponent 7 d of the subleading correction to /3n in dimension d > 2 , as defined 
in Eq. (6.4), is 


7 d 


d-2 
d 


(6.5) 


for any value of p. Notice that in the mean-field limit d —> 00 one recovers the 
subleading scaling 0(N -1 ) of the random assignment problem [95,156]. 

The main focus of this work is the Ebmp with quadratic costs, i.e. the case 
p = 2 in Eq. (6.2). In Section 6.2, inspired by some considerations on the continuum 
equivalent of the matching problem, the so called Monge-Kantorovic problem, we 
present a powerful ansatz, Eq. (6.15), for the asymptotic dependence of the optimal 
cost from the realization of the disorder. After a careful treatment of the diverging 
quantities, through an appropriate renormalization procedure, we obtain a whole 
new set of analytic predictions for In fact we recover the whole scenario given 
in Eq. (6.4) for p = 2, deriving the proposed expression Eq. (6.5) for 7 ^ as well. 
Moreover we refine the classification given in Eq. (6.4), with 
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B {2) 

Pn 


(d) 


\N + e 

d = 1 , 


SFln N + 4 2) 

c4 

II 

-e 

( 6 . 6 ) 

4 2) + W N ^ d 

d> 2 , 



where Cd(x) is the Epstein zeta function. Here and in the following the symbol ~ 
means that the term on the l.h.s. is asymptotically equal to the r.h.s. except for 
some additional term decaying faster than each term in the r.h.s. (e.g. 1 ) = 

g N + e y { + o(l)). While the coefficients e y d ; have to be determined numerically, we 
managed to obtain analytically the coefficients of the leading order expansion of /3n 
for d = 1,2 and of the subleading order for d > 2. In the following Sections we give 
a detailed derivation of these results. 


6.2 A scaling hypothesis for the quadratic cost 

6.2.1 The Monge—Kantorovic problem and Monge—Ampere Equa¬ 
tion 

Let us now briefly introduce the so called Monge-Kantorovic problem, as the 
conclusions of this paragraph have a crucial role in the following discussion. Given 
two measure densities p\: T d —> M + and p2 : T d — > M + , T d = M. d / 7 L d being the 
d-dimensional flat torus, f Td p\(x)d d x = f Jd p2{x)d d x = 1 , we define AI as the set 
of measure preserving maps /x: T d —> T d , i.e. the set of all maps p such that: 

Pi (x) = p 2 (n(x)) detJ M (x) Vx € T d , (6.7) 

where J /i (x) is the Jacobian matrix of /x, (J At (x))^. = |^(x). Given a transportation 
cost function w : T d x T c? —> M + , we introduce the cost functional 

E [n;w]= [ w(x, n(x))pi(x)d d x. (6.8) 

Jt d 

We ask for the map M £ M that minimizes the cost functional ( 6 . 8 ), i.e., such 
that E[M;rc] = rnin^g^ E[/x;u>]. This problem is known in Measure Theory as 
the Monge transport problem [183,184] and a lot of results have been obtained 
regarding the existence of the optimal map and its properties [185]. One of the 
most interesting cases is the quadratic one, in which the cost is given by the convex 
function w(x, y) = ||x — y|| 2 , and we have to minimize the functional 

E( 2 ) [p] = [ l|x - p(x)|| 2 / 9 1 (x)d d x. (6.9) 

Jj d 

In the case of quadratic cost it can be proved that the optimal map can be expressed 
as the gradient of a certain function <p [184], i.e. M(x) = grad</?(x). Eq. (6.7) can 
be than rewritten in terms of ip, obtaining the so called Monge-Ampere equation 

Pi{x) = p 2 (grady>(x)) det Hess^(x), 

where (Hess ^(x))^. = ggg is the Hessian matrix of p>. 


( 6 . 10 ) 
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Suppose now that pi(x) = l + 5pi(x) and p 2 ( x ) = l + e)/C> 2 ( x ) , being |<5pi(x)| <C 1 
and | 5 /c» 2 (x)| <C 1 Vx 6 T <z . We expect that, under these hypothesis, we can write 
M(x) = x + m(x) with ||m(x)|| <C 1 Vx G T d : in the first order approximation, 
det Jm(x) ~ 1 +divm(x), so Eq. (6.7) becomes: 

divm(x) = p\ (x) - p 2 (x) = Sp(x). (6.11) 

In particular, if w(x, y) has the form as in Eq. (6.9) we can introduce m(x) = 
grad 4>(x), obtaining the simple Poisson equation 

A<p = Sp. (6.12) 

Denoting by 5p n = f Jd Sp(x) e~ 2mn x d d x, in this case the total cost of the transport 
is given at the first order by 

E ( 2 ) [M] » f [grad0(x)] 2 d d x= ^ ( 6 - 13 ) 

JT nez^fo} 47r H n H 

Although the last equation has been derived under assumptions difficult to justify 
in the discrete and random version of the Monge-Kantorovic problem, that is in the 
Ebmp, we will see how Eq. (6.13) retains its validity also in that case. 

6.2.2 The scaling ansatz 

Inspired by the previous considerations, we made an ansatz about the functional 
dependence of the optimal cost of the Euclidean bipartite matching problem with 
quadratic cost from the density of the two sets of points. The ansatz is simple, yet 
it is surprisingly predictive. 

We denote with p B (x) = T Ya=\ 5 ( x ~ b i) = /h( x ) and with pn(x) = T $ (x 
p 2 ( x ) the random densities in [0, \} d of the N , 6 -points and 77,-points respectively. 
We suppose that periodic boundary conditions are imposed, so we work on the 
torus T d , as explained in the introduction. Let us call 6p(x) = pg(x) — pn{x) the 
difference between the two densities and 

1 N 

S P-=mT, (e“ 2 ” n ' bi - e~ 2ninri ) n G Z d , (6.14) 

its Fourier modes. Following the hint given by the continuous problem, Eq. (6.13), 
we introduce the following functional 


S N [Sp] = 


E , 

nEZ d \{0} 


I ^ Pn | 

47T 2 ||n|| 2 


(6.15) 


Our hypothesis is that the functional £n[^p] at large N captures the leading terms 
of the exact optimal cost E y N [n*; {r*, b,}], i.e. asymptotically {r^, bj}] ~ 

£n[5p], in the notation of Section 6.1. Note that we are using only (6.12) to evaluate 
the scaling of the optimal cost, without any reference to the optimality conditions 
itself. However, this is sufficient to reproduce the correct average behaviour: in 
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fact, in the limit of validity of our linearisation of the Monge-Ampere equation, the 
solution of (6.12) on the torus is unique and therefore determines automatically the 
optimal map. It can be shown by direct calculation that \dp n \ 2 = for each n / 0. 
Therefore we have 


E [2 \d) ~ S N [Sp] 


1 

2t r 2 JV 


E 

nEZ d \{0} 



=► (3%\d) ~ ms N [5p\ 


E . 

nEZ d \{0} 


2 -d 

N~d~ 


27T 2 llnll 2 


(6.16) 

For d > 2 the sum in the previous relation is divergent. However, by means of a 
proper regularisation of the sum, we can still extract useful informations on the 
scaling of (d^. For d = 2 Eq. (6.16) provides, after the regularization procedure, the 
leading scaling behaviour with the correct prefactor, whilst for d > 2 the procedure 

gives the leading scaling and the prefactor of the subleading behaviour. Sadly, in 

( 2 ) 

no case for d > 2 the coefficient, which we name e\ , of the leading term in the /3n 
expansion can be computed using our formalism. 


6.2.3 Case d — 1 
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Fig. 6.1. Numerical simulations for d = 1; the fit was performed using the three parameters 
fit function /( 2 ) (A) = a[ 2) + + 772 • 


Let us consider the Ebmp in dimension d = 1. In low dimensions, that is for 
d = 1,2, the optimal cost is no longer a subadditive quantity and the fluctuations of 
the density of points are dominant [59]. Moreover for d = 1 the optimal cost is also 
not self-averaging [59], while for d = 2 this is still an open question. 

In one dimension the structure of the optimal matching is known [59,96]: for 
any p > 1 and using open boundary conditions, the optimal matching is the one 
associating the &-th blue point to the k- th red point, ordering the points from left to 
right along the line. This consideration leads to the prediction /3]y ; (l) = 0(N 2 ) for 
the leading behaviour with generic cost exponent p. For closed periodic boundary 
conditions, the case we are considering, a similar scenario holds: enumerating the red 
points and the blue points clockwise or anticlockwise, the optimal matching is given 
by a cyclic permutation, with offset to be determined by the optimality condition. 

The one-dimensional case constitutes the simplest application of our formula, 
Eq. (6.16), since this is the only where the sum is not divergent. We obtain 
straightforwardly 


0 (2) 

Pn 


(i)EyiJ 
K 1 ^2 , n 2 


7 r 


n= 1 


7T 


6 


(6.17) 
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This is indeed the exact asymptotic behaviour of /3n [96], and it is a first validation 
of our very simple ansatz, Eq. (6.15): we were able to catch both the anomalous 
scaling O (N) and its correct prefactor. 

We checked the validity of Eq. (6.17) averaging the optimal cost of the Ebmp given 
by an exact algorithm [107] for system sizes up to N = 2048. We found the numerical 
data for jjPn to be well approximated by a three parameters fitting function of the 

/o) /o'i g(^) 

form /] (A r ) = + p- + ^ > where an additional correction of higher order is 

included. From a least square fit we obtained the coefficient = 0.166668(3), in 
perfect agreement with our analytical prediction (see Figure 6.1). 

Once verified the validity of Eq. (6.17), we used it to extrapolate the subleading 

(n\ (o) -i /o') 

coefficient e) , fixing cc) = ^ and using the fitting function /] (N) with two free 
parameters (see Figure 6.1 and Table 6.1). 


6.2.4 Case d = 2 




( 2^ 

Fig. 6.2. Numerical simulations for d = 2. We fitted our numerical data for p N {2) using 
the function fP\N) = a In N + Sp + P ' N . The correction was suggested by the 
right hand plot. 


As already stated in the introduction, in dimension two we have that Pn = 
O (In N). In this paragraph we will show how to derive this scaling from our ansatz, 
Eq. (6.16), and we will also obtain the corresponding prefactor. The sum appearing in 
Eq. (6.16) diverges in dimension two and above, therefore we have to find a suitable 
regularization to give meaning to the expression. The regularization procedure 
presents some peculiarities at d = 2 from which the anomalous scaling arises. 


We choose a regularizing smooth function F(x) such that E(0) = 1 and F(x) —> 0 
for x —> Too. The function has to decrease rapidly enough to make the series 
SneZ 2 \{o} (v=r) converge: here we introduced a cut-off in momentum 

space, 27r£~ 1 , where £ = is the characteristic length for the system, being 
£ of the order of the average distance between a blue point and the nearest red 
point. Clearly 2tt£~ 1 —> Too for N -r Too. Finally, let us denote by A fd(r) = 
{x € Z d \ {0}| 11 x 11 < ?’} , the number of lattice points (excluded the origin) included 
in a ball of radius r centred in the origin in dimension d. Then, for arbitrary 
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d = 1 

d = 2 

d = 3 

d = 4 

d = 5 

2^0(1) 

(2) 

a d 

e {2) 

e d 

1 

6 

0.166668(3) 

-0.1645(13) 

0.1332(5) 

-0.45157... 

-0.4489(16) 

0.66251(2) 

-0.28091... 
-0.282(4) 
0.571284(6) 

-0.21423... 

-0.2139(13) 

0.584786(2) 


Table 6.1. Results of numerical simulations for p = 2. In the first line the analytical 
prediction for oc d for d ^ 2 is presented. 


a £ (0,1), we can write 
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Vn 


where we have isolated in the last term the singular part of t 

rR j 

Ja r 


^ (6.18) 
he series. The hrst 


integral in the right hand side is well behaved: indeed, f a ^ 
_|_ jR Njr)—nr- 


9^2 ( r ) 


dr 


— 2irr 
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Abfr )—wr 
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2 r 3 


Both the hrst and the second term are finite in the 


R oo limit due to the fact that [186] N 2 V) — vrr 2 < 1 + 2\J2,tt r. Therefore we 
have 
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r F 
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n 


Vn 


+°° 1 r oi Vn 

—^ N 2 V) — vrr 2 dr+27rlog-|-27r 

2 r 6 L J a 


nez 2 \{0} 

Eq. (6.16) for the case d = 2 can then be rewritten as 

fl(2)/ 0 N In N (2) 

Vn V) ~ + 4 • 


3h dr . 

r 

(6.19) 


( 6 . 20 ) 


(2) 8^(2) 1 

where is some constant. To our knowledge the result liniAr^oo ^ is 

new to the literature. 

The validity of Eq. (6.20) has been confirmed by numerical simulation with 
system sizes up to N = 4 • 10 4 . We found a three parameter function of the form 
(IV) = a In N + e^ to be the best suited to fit the data for /3n- From a 

least square fit we obtain the coefficient 2-kci = 1.0004(6), in perfect agreement with 
our analytical prediction (see Figure 6.2). Once verified the validity of Eq. (6.20), 
we used it to extrapolate the subleading coefficient , fixing a = ^ and fitting 
the other two parameters (see Figure 6.1 and Table 6.1). 


6.2.5 Case d > 2 

In dimensions greater than two the average optimal cost has the leading scaling 
E ( n \d) = 0(N~d) that one could expect from very simple arguments [18], as 
already stated in the introduction. This is in fact the scaling obtained if each point 
is matched to one of its nearest points of different type, being their distance of order 
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TV-73 




( 2 ^ 

Fig. 6.3. Numerical simulations for d > 2. We fitted our numerical data for (3 K N (d) using 
the function f^ 2 \N) = e^ + off N~ ld + J). The expected value for was 


0(N~d ). Moreover it has been proven, using standard sub-additivity arguments, 
that /3n is a self-averaging quantity and has a finite limit for d > 2 [59]. We will 
show that our ansatz Eq. (6.15) accounts for the subleading corrections to /?tv- 
For d > 2 the series ]Cnez d \{o} jj^jp is divergent. As in the previous paragraph, 
we use a sufficiently rapidly decaying function F(x), with lim^-^oo F(x) = 0 and 
lim-r^o F(x) = 1, to regularize it. The characteristic length of the system is given by 
£ = -^=. Denoting as before by Afd(r) the number of lattice points inside a sphere 
centred in the origin and of radius r, with the exclusion of the origin itself, we can 
write 
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nez d \{0} 
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(J 4 ) 


'0 


+oo ^ 

^2 F 


r+oo ^ 


yfN 

dAf d {r) 

dr 


dAf d (r) 

8r 
-S d r d - 1 


~S d r 


d-1 


dr + N d, S d 


dr + N—S d 


d 

2n? 


F (r) r d 3 dr. 

( 6 . 21 ) 


where S d = is the unit sphere surface in d dimensions. The last term in 

r v 2 J 

Eq. (6.21) gives the leading order contribution to /3n, but in our formalism it cannot 
be explicitly computed since it depends on the choice of the regularizing function 
F(x). We name the other integral on the right hand side as 



+oo ]_ 


9 Af d (r) 

dr 



dr. 


( 6 . 22 ) 


Ti d gives the first subleading correction to the leading scaling of /?jv- Moreover it 
can be shown (see appendix C.l) that T, d = Cd(l)> the analytic continuation to the 
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point s = 1 of the function 


Cd(s) = TT-pj for Res > ^. (6.23) 

nGZ d \{0} H n ll 


The previous function is a particular case of a more general class of zeta functions, 
called Epstein zeta functions. Therefore we are able to compute analytically the 
subleading behaviour of (5n for d > 2 , 


d (2) 

Pn 


(d) 


,( 2 ) 


+ 


Cd(i) 

2yr 2 iV^ ’ 


7 d = 


d -2 

IT' 


(6.24) 


(2) 

The expression for Crf(l) is given by Eq. (C. 6 ), while the intensive costs e d have to 
be determined numerically. Note that for d —>■ +oo we recover the correct meanfield 
scaling behaviour already analysed by [59] for the random assignment problem, i.e. 
jd —> 1. However, for finite d, the scaling behaviour can be very different from the 
mean field one. 

We verified the validity of Eq. (6.24) with numerical simulation on systems with 
sizes up to N = 10648 in dimension d = 3, N = 14641 in dimension d = 4 and 
N = 32768 in dimension d = 5. We used three parameter functions of the form 

(2) (2) ot^ (21 

fd \N) = e y d + + fj to fit our data for @ y N (d). The scaling exponents 7 d are 

readily confirmed to be the right ones (see Figure 6.3) and the fitted coefficients 
ap are in strong agreement with the analytical prediction (Table 6.1). Then 

we fixed the aP = pjp in fp\N) to extrapolate the extensive coefficients e:p , 
reported in Table 6.1. 


6.3 Results for generic p 


( 2 s ) 

The asymptotic form we proposed for the average optimal cost E N (d) in the Ebmp 
with quadratic costs and periodic boundary conditions, Eq. (6.15), could not be 
extended to cover the case of generic cost exponent p. Nonetheless, our numerical 
simulations give strong evidence that, for d > 2 and any p > 0, (3n has the asymptotic 
form 

(P) 

~ 7" + %~ d , 7d = (6.25) 

We thus find the same scaling exponent 7 d analytically predicted only for the case 
p = 2. The non-trivial scaling exponent 7 d differs from the mean-field exponent 
7 oo = 1 of the random link matching problem [95] and of the Eucliden monopartite 
matching [59]. The identification of the correct exponent 7 d is crucial to the 
extrapolation of e d from numerical data. Since in the literature a mean-field like 
scaling has been considered [59], we report in Table 6.2 the values of ep and aP 
for different values of p. They were obtained fitting /3n with functions of the form 

fd P \ N ) = < 4 P) + Tru + In Figure 6.4 we plot and dp for ^ = 3,4, 5, 

along with the data already presented for p = 2 for comparison. The scaling exponent 
r Yd = pp is confirmed by our simulations. Generalizing the case p = 2, we therefore 
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TV 14 


N~i 5 


Fig. 6.4. Numerical simulations for d > 2. We fitted our numerical data for (3^\d) 
using the function f d p \N) = e^ N~ ryd + We plotted the results obtained for 

p = 1,3,4. Fit results are presented in Table 6.2. 


conjecture that the optimal cost as a function of the difference of the density of 
point <5p(x), for |<Sp(x)| <C 1 and in dimension d > 2, can be approximated by 


nEZ d \{0} 


\8Pn\ 

47T 2 11 n 11 2 


(6.26) 


a(p) 

where AJ are unknown parameters. From last equation, the asymptotic form Eq. 
(6.25) for /3n can be derived, but at odds with the case p = 2 where A d = 1 for 
any d , the lack of knowledge of the value of the parameters A^ forbids the analytic 
prediction of the subleading coefficients af ' 1 . We also notice that Eq. (6.26) cannot 
be extended to dimensions d = 1,2, since it is incompatible with the scaling scenario 
depicted in Eq. (6.4). 

The ansatz given in Eq. (6.15) for p = 2 has been a posteriori confirmed by the 

( 2 ) 

correct prediction of both the exponents 7 a and the subleading coefficients a d '. On 
the other hand, for generic p, the ansatz (6.26) is only supported by the fact that 
it gives the correct exponents 7 a, which is the reason itself why it was introduced. 
Therefore we tried to verify the internal consistence of Eq. (6.26). In fact after some 
algebraic manipulations and averaging over the disorder one can derive 

A (v) ^ \\ n \\^N ^0)[ 7r *,| r . )b .|] _ e (p ) s ^| \Sp n \ 2 . (6.27) 

where we used the notation introduced in Eq. (6.3). We computed numerically 
the r.h.s of the previous equation for d = 3 and sizes up to N = 10648. The 
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Table 6.2. 



d = 3 

p = 1 

d = 4 

d = 5 

Q, 0 ) 

a d 

JP) 

e d 

-0.233(2) 

0.7472(2) 

-0.152(17) 

0.7181(2) 

-0.127(16) 

0.73905(5) 


d = 3 

p = 3 
d = 4 

d = 5 

(P) 

^d 

p w 

e d 

-0.652(3) 

0.6313(2) 

-0.36(1) 

0.4804(1) 

-0.28(4) 

0.4830(1) 


d = 3 

p = 4 
d = 4 

d = 5 

(p ) 
a d 

Jp) 

e d 

-0.863(3) 

0.6286(2) 

-0.44(2) 

0.4183(2) 

-0.34(1) 

0.41043(4) 


Results of the fit of numerical data for f3^\d) by a function of the form 



C 

N' 



p = 1 p = 2 

P = 3 

p = 4 

A^ from Eq. (6.26) 

0.516(5) 1 

1.44(1) 

1.908(4) 

A^ from Eq. (6.27) 

0.51(3) 0.99(2) 

1.46(3) 

1.96(2) 


Table 6.3. Values of A^ for d = 3, extrapolated from Eqs. (6.26) and (6.27) respectively, 
as explained in the main text. The error in the second row are upscaled by a factor ten 
from those given by our fitting program (gnuplot), to assure the compatibility with the 
case p = 2 . 


computation is numerically quite heavy since the density fluctuation are small. 
While the l.h.s. of equation (6.27) is independent of the mode n in the large N limit, 
we observed a finite size effect that seemed to be best accounted for by the scaling 
form A 3 ^ ( n , N) r\j + b- 3 + c (4^=) . Using this three parameters function to 

fit our whole set of data (|jn|| < 10) at fixed p, we extrapolate the values of A\f ' > 
that we report in Table 6.3. In the same table we compare these extrapolations 

with the predictions steaming from Eq. (6.26), that is where 

^d 
(p) 

the coefficients cU where computed in Table 6.2. The agreement between the 
two different sets of values is quantitatively and qualitatively good, even though 
we cannot definitively affirm the validity of Eq. (6.26) due to the complexity and 
imprecision of the procedure utilized to test it. A more sound verification would 
be to manually excite one of the modes through the addition a position dependent 
shift of the form encos(27rn • x) to each randomly generated point in one of the sets. 
One should then observe a linear response of the totat cost to the variation of e as 
predicted by Eq. (6.26). 
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6.4 Conclusions and perspectives 

In the present work we proposed a simple form for the asymptotic behaviour of the 
average optimal cost, in the Euclidean bipartite matching problem with 

quadratic costs and periodic boundary conditions. This ansatz, Eq. (6.15), contains 
no free parameters and leads to a strong set of predictions in every dimension, 

(2) i?(2) 

resumed in Eq. ( 6 . 6 ). The rescaled cost p N (d) = —Aj- for low dimensions is a 

N d 

diverging quantity in the Ebmp, at odds with the monopartite case. We were able 

, 8 ^( 2 ) -i 

to prove that linijv-^oc — = g and limjv_*x> ^ N = 97 for d = 1 and d = 2 

respectively. Above the critical dimension of the system, d = 2 , the rescaled cost 
(2) 

fl y N (d) has a finite limit which is inaccessible to our formalism. We were able though 
to determine analytically both the subleading scaling, 0(N~ ld ) with 7 d = and 
its prefactor All the above claims are overwhelmingly supported by numerical 

simulations. 

Finally, we provided numerical evidences that, in dimension d > 2, the subleading 
scaling exponent 7 d we predicted for the case of quadratic costs is the same for 
arbitrary cost exponent p. This led us to extend the ansatz proposed for quadratic 
costs, Eq. (6.15), to the general form Eq. (6.25) for d > 2. We tested numerically 
the validity of Eq. (6.25), obtaining good but not definitive results, therefore we 
proposed another numerical procedure that could give a firmer validation to the 
theory. 

Although our scaling ansatz proved itself to be very powerful, as discussed above, 
a deeper theoretical investigation is required to derive analytically the limit of /3 ^ ( d) 
at large N, not computable in our framework. Moreover, a rigorous justification of 
our simple ansatz is desirable, and could be inspired by the considerations we made 
in Section 6.2.1 on the Monge-Kantorovic problem. 
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Part IV 

Beyond the Bethe 
approximation in finite 
dimension 




Ill 


Chapter 7 

The Euclidean Matching 
Problem 


We consider in this Chapter the Euclidean matching problem (EMP), not to be 
confused with the bipartite Euclidean matching problem we dealt in Chapter 6. Here 
there is no local density fluctuation among the points belonging to different sets, 
trivially since there is a unique set of points. As a consequence the source of the 
anomalous scaling behaviour addressed in Chapter 6 here is not present, and the 
leading cost is extensive in any dimension once rescaled according to a standard 
prescription. 

We will perform a first principle calculation for the average cost in the EMP 
using the replica method, generalizing the computation of Parisi and Mezard [58]. 
Since the replicated action contains infinitely many diagrams, we will approximate 
the result considering only the terms corresponding to polygons, something akin to 
the HNC approximation for liquid systems. 

We compute the contributions of polygons as a perturbation to the mean-field 
(Bethe) term. We will show that this loop contributions are formally equivalent to 
the terms appearing in the O (1 /N) correction to the total cost in the random-link 
matching problem, the one with independent random costs, as recently computed 
by Ratieville and Parisi [95]. In Ref. [95] the finite size correction was computed 
according to the scheme we presented in Chapter 4, the only difference being that 
the authors proceeded through the diagonalization of the Hessian, therefore leaving 
uncovered the connection with the simple loops of the graphs. Here we establish 
this connection, relating the random-link model with the Euclidean model, where 
the terms in the action corresponding to loops appear explicitly since the beginning 
of the calculation. 

Ultimately both the first finite size correction in the mean-held system and the 
polygons’ contributions in the Euclidean model are due to the presence of simple 
loops of finite size in the interaction graph. The only difference is that the correlations 
among the cost of the edges in the loops are present only in the Euclidean system. 
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7.1 Replica calculation 


Let’s consider the monopartite euclidean matching problem with N points uniformly 
distributed in the [0, l] d box. The rescaled intensive energy e n, according to the 
considerations of Chapter 6 is defined by 


ejv 


1 

N x ~d 


E l*i ~ X 3 

i<j 


n. 


y 


(7.1) 


where n*j is the optimal matching and p > 0 is the cost exponent. Notice that we 
choose to work with N points, as in Ref. [59], instead of the 2 N points of Ref. [58]. 
This to compare our result with the more up to date numerical computations of 
Houdayer. 

We will give the details of the calculation since they are non-trivial and where 
not specified in the original articles of Parisi and Mezard [18,58]. We denote with • 
the average over the distribution the joint distribution of the lengths £ t] = \x{ — xj\ 
as induced by the uniformly distributed displacement of the points in the box. The 
replicated partition function for the model reads 


n N 


{n^}a=li=l j 


i<3 


dAf i\ a 
—e lA * 

2vr . . 

^,a cl i<j 


JJ n II f 1 + 


-/ n^na + 

i,a i<j 


U. 


"i3)i 


(7.2) 

(7.3) 

(7.4) 

(7.5) 


where in the last line we defined 


u 


v 


= E 


—rBNdlV. 

O r' i'i 


r =1 


e~ i ^aeJ x i +X 3). 

a:|o;|=r* 


(7.6) 


We can now expand the products of the u t] as a sum over all the subgraphs of the 
complete graph. If we call K = {(i,j) : i,j = 1,..., N} the set of the N(N — l)/2 
edges, we then have 

n (i+ Uij )=i + e n( ? - 7 ) 

i<j EcKeeE 

A scaling analysis of the lengths distribution shows that leading order contributions 
in N are given by generalized loops, that is subgraphs with no dangling edges. We 
keep only the terms corresponding to simple loops, so that our approximate partition 
function takes the form 


Z n 


2ir 

i,a 


(7.8) 


(7.9) 
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Introducing the order parameters 


i N 

i —1 


a C {1,..., n}, a / 0, 


(7.10) 


and as the associated Lagrange multiplier, we can write 


f JJ^-e^JJdQadQa e-^Qc+iQ^e-^ 

i,a ex. 


x 

£cx ^ 


x e 


2 X)r=l 9r X) a :|a|=r Qa +N J2t>3 21 X) n ,...,r f 3r 1 ...r e X) a: | Q |=r Q a l u “2 ' ■■Qa e Uo, 1 


(7.11) 

Here the notation |a| = r stands for a\ = rq, a.i = ^ 2 , .... We have also defined 
the averaged quantities 


g r ^s d [dll d -‘e- Blr = r -^, 


>• V > 

(M 


g ri ..,r t = I d P e (h,...,k) e-f>TL.rX 


(7.12) 

(7.13) 


with the spherical shell surface given by S c j = 


d 

dir^ 


r(i+|) 


■j-. P( is the joint distributions of 


the lengths in the polygon of t edges. Now that we have decoupled the sites we can 
perform the integration over the lambdas. We obtain 


z n ^ / n d 0adQ c 


0 -pNS[Q,Q\ 


(7.14) 


The action replicated free energy S[Q,Q\ is defined by 

S[Q,Q] =Smf[Q,Q] + E^[Q] 


e>3 


(7.15) 


with 


1 


-/3Smf[Q, Q] = - E iQaQa + o y Zsr E Qa 

a r= 1 a:\a\=r 

dX 


T log 


TT — pT.a^+T.JQo 

11 2?r 


-*E a 


and 


(7.16) 


-/>*[«]= £ fjr\ ...rt, E QoiiUot 2 Xcx£C\Oii=0 • • • Qa^Uai Xa^Dai=0? (7.17) 

r lv-7 r ^ a:|a|=r 


where x is the indicator function. 

We will now compute the partition function (7.14) through saddle point evalua¬ 
tion. 
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7.2 RS saddle point 

We restrict the saddle point analysis to the mean field action. Subsequently we will 
consider the terms Sg as a perturbation to the the saddle point. Therefore the saddle 
point equations read 


iQa 9r(a)Qa (7.18) 

Q a =« e ~* A “ » (7.19) 

Here r(a ) is the cardinality of the set a, r(a) = |a| and the expectation << • >> 
is over the (normalized) integrand in the logarithm of Eq. (7.16) 

In order to compute the saddle point we make the Replica Symmetric assumption 

Qa = Qr(a)i iQa = 'i'Qr(a)- (7.20) 

At the leading order in small n, after some manipulations [19], the replicated action 
is given by 


/ 1 \r*—1 1 C 1 — 1 

-PSmF ~ n\ - Y, —- j QrQr + 9 E —- 9rQl 


r> 1 


2*7 r 

r> 1 


— [ du (e £U — e ^ 




(7.21) 


It is now convenient to parametrize the variable Q r , Q r with the function 


G(u) = Y, { —^ i Qre f3ru 


r> 1 


y I 


(7.22) 


In the previous definition we inserted a factor /3 in the exponent to have a good 
zero temperature limit, as we shall later see. From last two equation it follows 
immediately 


Smf = n | \ J e ~ J ( 


e~ ePu - e~ G ^ u 




To write last equation we also exploited the saddle point equations 

1Qr — Qr Qr 


and 


Q r = f3 J du 


c Bru 

e —re~ G ^ 

r\ 


(7.23) 


(7.24) 


(7.25) 


From last two equation and the definition of G(u ) given in Eq. (7.22), we can write 
a saddle-point self consistent equation for G(u): 
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with 

+ 00 ( — 1 1 

'to = E = 1 “ Jo ( 2el ) (7 ' 27) 

In Eq. (7.26) we also introduced for convenience the coefficient s, defined as 

s= d - 1. (7.28) 

P 

7.3 Corrections from polygons 

Using the RS assumption and treating the term Sf as a first order perturbation to 
the mean field saddle point, the correlation terms in the action due to the polygonal 
graphs can be written as 


* —4 E /lU^ (7.29) 

. We see that in the spatial part we have a convolution, therefore we can apply a 
Fourier transforms to deal with it. We define the function 

9r(k) = S d Jdl l d ~ l e-? rlP oEl (J(7.30) 

in order to write in the loop free energy in the compact form 
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In the last line we have introduced the operator 


(7.31) 


r ^-'otot , {}^) — Qr-\-r' 1 aHa'=0 y 9r(k)g r >(k), (7.32) 

which is the analogue for the Euclidean matching problem of the operator of Eq. 
(4.22) we encounter in Chapter 4 when dealing with diluted graphs. An import 
difference here, is the presence of spatial correlations in the couplings on top of the 
simple loop topology, due to the Euclidean structure of the ambient space. From 
now on we shall omit the dependence on k. Following Ref. [156] we decompose 
the matrix T in the irreducible representations of the replica permutation group. 
The method is similar to the spectral formalism we employed in Chapter 3 for the 
replicated Ising transfer matrix. The restriction of T to the irreducible subspaces 
Db\q = 0,1 ,... , is given, in the mall n limit, by the matrices 


JV“ = (-1)' 


(r + r' — l)!(r / — 1)! 

(r — l)!(r' — q)\{r’ + </ — !)! 


Qr+r 1 'J 9r9r' 


(7.33) 
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Still following Ref. [156] we can apply a transformation to the matrices N ^ that 
does not alter the eigenvalues. We then consider the matrices 



aAq) ~ ( vr'+q ( r + r/ + 2 <? - 1 )! n ~ 

M rr'-\ 1 ) ( r + 2q-l)lr’\ Qr+r+2q 9r '+q 

(7.34) 

The eigenvalue equation for M I'd reads 


\ ST nAv) / i)« 1 YW iW {r + r' + 2q- 1 )! 

Ac r — 2 j M rr , C r t — ( 1) ^ 2 ^ _ -*■) r /| Qr+r'+2q9r'+q c r‘ 

r e P{r+q)v e P(r'+q)v-G(v) 

= (- 1 )^/dq r+ 24 _i),D-ir r ,, 9 , + »c, 

(7.35) 

We can then turn last eigenvalue equation in an integral eigenvalue equation noticing 
that if {c r } satisfies last equation then 


J3{r+q)u-^k9 

/(«) = X)( 1 Cr9v+q 

r ^' 

(7.36) 

satisfies 

A f(u) = (-!)« J du A (q \u,v)f{v) 

(7.37) 

with 

A^\u, 

g ( , ^iy e pr{u+v) _ 

v)=l3e 2 2 ^ (r + 2q-l)\r\ 9r+q{k) 

(7.38) 


We notice that depends implicitly on the mode k through g r+q (k) defined in 
Eq. (7.30). 

Finally the contribute in the action of the polygons of length t can be expressed 
in terms of the traces of the operator as 

/d^- 1 TY((-lM« ) )'. (7.39) 


In last equation, as expected from the discussion of Chapter 3, the Sectors’ degen¬ 
eracies are given by 


d q = 


n 


n 

q~ 1 


(7.40) 


and in particular do = n and d\ = n — 1 . 


7.4 The zero temperature limit 

7.4.1 Mean Field term 

Let us consider the limit (3 t °o for the mean field part of the action. For the function 
I(x) defined in Eq. (7.27) we have [18] 


lim I(/3x) = 9(x). 

/3—>-oo 


(7.41) 
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The argument leading to the above equation involves the representation of the sum 
in I(x) as a path in the complex plane. The saddle point equation (7.26) becomes 

G(u) = — [ dv (u + v) s 6(u + v) e~ G ^ u \ (7.42) 

P J 

We can then compute the average cost of the optimal matching in the mean field 
approximation through the formula 

eMF = lhn lim —- (7.43) 

—^oo n-> 0 n 

= IJ du G(u) e~ G{u) - J du (e{-u) - e - G(u) ) (7.44) 

We now turn to the computation of the zero temperature limit for the polygonal 
corrections to the free energy. 


7.4.2 Longitudinal and Anomalous Sectors 

Before considering the T J. 0 (i.e. (5 f oo) limit for the average free energy, some 
considerations regarding the Longitudinal and Anomalous sectors, represented by 
the matrices N® r , and N^ r ,, in the decomposition of T aa i. At finite n the two 
representations read [95,156] 

(n) = ( U ^ r "| Q r+r ' \ZfJr9r' r, r = 1 ,..., n (7.45) 


whose n eigenvalues have to be counted multiplicity do = 1, and 


N^(n) 



Qr+r' 'J9r9r‘ 



r,r = 1 ,..., n — 1, 


(7.46) 


which has n— 1 eigenvalues, each one contributing with a multiplicity d\ = n — 1. As 
it can be readily seen the two matrices have the same limit at n = 0. At odds with 
the replicated Ising transfer matrix considered in Chapter 3 though, the dimension 
of N is n and not n + 1, and for n \. 0 all its eigenvalues coincides with the one 
of N^\ and the total multiplicity then becomes n, as expected. In the Ising RTM 
case instead, the first eigenvalue A = 1 of the Longitudinal Sector does not appear 
in the Anomalous Sector. 

The correspondent continuous operators, according to definition (7.38) and after 
some manipulations, differ only by an overall minus sign, and are given by 


(u,v, k) = (—l) 0 / 1 —e 
P 


Sd G(.) G(v) 


dl I s o Fi 


d 1 2; - 
--k b 
2’ 4 


(7.47) 


The operators A^^\u,v]k) are thus well defined in the zero temperature limit, 
where we obtain 


A^°^\u,v, k) = (-l) 1/0 e 


GW 

2 


G(v) 

2 Q k (u 


(7.48) 
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with 

@k(h) = j h s 9(h) 0 Fi (1,--^k 2 . (7.49) 

Therefore eigenvalues of A l 0 / 1 ) are finite and, due to the factor ^ in Eq. (7.39), 
do not contribute to the zero temperature limit of St- 

A finite contribution is given by the first order correction to the eigenvalues for 
small n though. Moving alone with the computation, in order to account correctly 
for all the terms in the small n limit, the eigenvalue shifts can be computed using 
the matrix 


A rr ' = lim 


( ~ 1} ^ L + V \ Qr+r> yJdrmAk ), 




(7.50) 


along with ordinary perturbation theory. The contribution to the loop correction St 
given by the degeneracy between the first two sectors is then given by 


Tt = - lim 

( 3 — 


S d 

(2n) d 


A 


dk k^yi-^X 

V 3 


A \t- 1 


(7.51) 


where A a is defined in term of the left and right eigenvectors eigenvectors, (L\\ and 
|.Ra), of N(°\n = 0) as 

Aa = (Ta|A|Ra)- (7.52) 

While we expect the eigenvalues A of to be finite in the large (3 limit, as 
discussed in the next paragraph. Moreover, according to result for the random link 
case of Ref. [95], we also expect Aa = 0(/3 ) for large (3, therefore we have a non-null 
contribution Tf from the first two Sectors to the zero temperature free energy. 


7.4.3 Sectors q > 2 


Following the same procedure of Parisi and Ratieville [95] we compute the /? t 00 
limit of the operator defined in Eq. (7.38). We will see that the limit is non 
trivial only if q is appropriately scaled with j3. In fact we can rewrite the operator 
A^ as 


/ \ G(u ) 

A^ q \u, v) = (3 e a - 


g(v) i Sd 

27r p 




(7.53) 


with 


e f)(u+V—l) 

S(z,£, q, /3) = /3q(u + v - l) - z + ---- 2qlog(-z) (7.54) 

For large j3 the exponential term in the integrand becomes concentrated on the point 
given by the saddle point conditions 


dS n dS n 

~d~z ~ 0; ~m ~ °’ 


(7.55) 


while the other terms in the integrand do not depend on (3. 
conditions give 


z 


* 


l* 


u + v — 2 


log (q) 
3 


The saddle point 


= -<?; 


(7.56) 
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It is easy to see that in the summation over q the only terms giving a non zero 
contribution are of order logc/ ~ (3. Fixing /3 to /3 = log {q)/t we obtain l* = u+v — 2t. 

The computation of the saddle point contribution and of the Gaussian fluctuation 
for the integral in Eq. (7.53) is formally equivalent to the one performed in the 
appendices of Ref. [95]. In the defining 



H kt (u,v)= lim A {g el3t \u,v), 

(7.57) 


p—>oo 

we obtain 

G(u) G(v) 

Hk, t (u, v) = e 2 2 Q k ( u -p v -2t) 

(7.58) 

with 

&k(h) = j h s 9(h) o F 1 . 

(7.59) 


We notice that ©o (u + v) corresponds to the kernel of the integral operator of the 
saddle point Eq. (7.42). Some considerations are now in order to proceed further. 
Since in Eq. (7.39) we have an alternating sign in q, we split the contribution in 
odds and even sectors. As showed in Ref. [95] the sectors q = 0 and q = 1 do not 
contribute to the zero temperature limit. For large (3 and small n we obtain, the 
contribution to Sj from the irreducible sectors with q > 2 is given by 


n S d 
(3 (2ir) d 


d k k d ~ l 


- E 

q>l 
q even 


2q - 1 

q{q - 1) 


TV 


«)'+(-d'E 


q>l 
q odd 


2q - 1 

q(q- i) 



(7.60) 


Moreover, still for large (3 the sum over the sectors q turns into an integral : 


1 

1 


E - 

qodd* 




(7.61) 


Finally, using the zero temperature limit of the operator A ^ given in Eq. (7.58), 
we arrive to compute the contribution to the energy of small simple loops from the 
sectors q > 2: 


Qe 


tHpj~dt.dk k d -‘T r Hi, 
0 


t odd 
£ even 


7.4.4 Wrapping it up 

The total average energy e in our approximation is thus given by 


e 


e MF + ^2 

e>3 



ei = lim lim — = 

/3-»oo n—>0 n 


(7.62) 


(7.63) 


where 


+ tig 


(7.64) 
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contains the contribution T g from the degeneracy of the Longitudinal and Anomalous 
sectors 


Yo = — lim 


S d 


(2vr Y Jd 

and the contribution form higher sectors 


dk k 


d -1 


E 

A 


Yip = 




Tr I I , 


k,t 


^A ,£-l 

T x ' 


l odd 
t even 


(7.65) 


(7.66) 


The operator Hp. t has eigenvalue A = 1 for k = t = 0. We show it taking 
the derivative of saddle point equation (7.42) for G(u ) and integrating by parts, 
obtaining the relation 


G\u) = J du 0 o (u + u) G\v)e~ G{v) . (7.67) 

Then it is easy to prove that the function 

h(u) = G'(u) e ^ (7.68) 

is eigenfunction of Hq,o with eigenvalue A = 1. 

We performed numerical simulations to compute the value of the eigenvalues 
of First we discretize the zero temperature saddle point equation (7.42) for 
G(u). Then we discretize the operator and compute its eigenvalues with the 
linear algebra library Armadillo [187]. The result is shown in Fig. 7.1. H^d has a 
discrete spectrum, its eigenvalues continuously decreasing in both k and t. We focus 
the analysis on the largest eigenvalue of Hp. t , since it dominates the trace of H ( kt 
for large l. The largest eigenvalue \(k. t ) is decreasing in t and k and, moreover for 
k = t = 0 we have A(0,0) = 1, with eigenfunction h(u) as already stated. For large l 
the dominant contribution in the integration over k and t is given by the region of 
small t and k. In that region the leading behaviour is given by 

A(fc,t) ~e- at - bk \ (7.69) 


as it can be seen in Fig. 7.1. 

Using the knowledge of the k = t = 0 eigenfunction h(u) defined in Eq. (7.68), 
we can use perturbation theory to determine the coefficient a and b of Eq. (7.69). 
Le us define the cavity message distribution 

P(u) = G'{u) e~ G{u) (7.70) 


Perturbation theory in t gives 

Sd J d u du P(u) (■u + v) s 9(u + v ) P'{v) 
p j du h 2 {u) 


(7.71) 


where in the second line we have used Eq. (7.67) along with an integration by parts. 
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t 



Fig. 7.1. Maximum eigenvalue of the operator H^ t of Eq. (7.58) as a function of t (left) 
and k (right). Black lines are numerical fit of the form A = exp (A — Bx — Cx 2 ). 


Using the analytic formula for G(u) 


G(u ) = In ^1 + e d u ' S j for d = p, (7.72) 

equation (7.71) gives 

a = ^ for d = p. (7.73) 

This result is confirmed by numerical simulations. 

The perturbation in k to is obtained expanding to the first order in k 2 the 
hypergeometric function in definition of g r (k ) in Eq. (7.22). We have 


1 Sd f dudv P(u)(u + v) s+ p 9(u + v)P(v ) 
6 p f du h?(u) 


(7.74) 


Some further progress can be made for p = 1,2. In fact a few integrations by parts, 
along with / G'er G = f P = 1, yield 


b 6/d«G' 2 («)e- G W f ° r P 2 ’ 

and 

(s + 2)(s + 1) f du G(u)e~ G ^ 

b= -6-JdaGrtMe-GM ! ° rP=l ' 

In the analytically solvable case d = p we have 


b = 



p = d = 1 
p = d = 2 


(7.75) 


(7.76) 


(7.77) 


Once we assume the leading dependence on k 2 and t of the eigenvalues A (k,t), we 
can perform separately the two integrations in flf 

1 1 

la' 


d t e~ aU = 


(7.78) 


dk k 


d-l -bk 2 l _ 1 ^( 2 ) 


„ d d 
?2 262 


(7.79) 
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Using these results to approximate we obtain 


£>'S 


s d r(|) v 

i 27T ) d 2cib% i 2+ i 

t odd 


(7.80) 


The sum over l can be expressed in term of the generalized Rienmann zeta 
function £(x,y), thus giving 


£>3 


s d r(|) i / d 3\ 

/ 9 W— ~I “7TT M 2 + 9’ 9 ) 

( 2vr ) 2 abz 2 2+ 5 V 2 2/ 


(7.81) 


A similar approximation can be done for the terms T^, at the present point we 
did not make the computation though. 


7.5 Finite size corrections 

7.5.1 Connection with the random link problem 

Let us take a step back from the Euclidean Matching Problem and consider the 
random link model, where the elements u>ij of the cost matrix are extracted inde¬ 
pendently at random according to a certain distribution (after a proper rescaling of 
the costs with N ) p(w) = cw 7 , where c, 7 > 0 are some coefficients. According to 
Parisi and Mezard [156], and as in the calculations we performed in Chapter 4 on 
diluted graphs, there are two terms contributing to the O (1/iV) correction to the 
average cost. The first one, A F 1 , comes from the 1/N correction to the action itself. 
The second one, A F 2 , is due to the Gaussian fluctuations around the saddle point. 
This second correction, at finite temperature, can be written, using our notation, as 

A F 2 = lirn -i- In det(I - T) (7.82) 

n-»o 2/3n v ' v ' 


with 

"1" aa' Qr(a)+r(a') lan«'=0 yj9r(a)9r(a') ~^Qr(pi)Qr(a') \J.9r(oi)9r(a') > (7.83) 

and 

g r = j dw p{w)e f)rw . (7.84) 

These last formulas differs from the ones presented in Refs. [156] and [95] due a 
different notation: their Q r is rescaled by a factor g r and the consider a matching 
among 2 N points instead than N. At this point we see that the matrix T corresponds 
exactly to our transfer matrix for the polygonal correction T(k) defined in Eq. (7.32), 
except for wo reasons. One is the dependence on the mode k. This is natural since 
in the random link model we loose the spatial correlation of the costs in the polygon 
and the zero mode encodes all the relevant information. The second is the additional 
term Q r ( a )Qr(a')- I n R- e f- [95] this is shown to contribute only in the Anomalous 
and Longitudinal sectors, and it has the effect of exactly counterbalancing the same 
contributions of the term Q r ( a )+ r ( a ') l Q na'> therefore 0(1/N) Gaussian fluctuations 
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in the random link problem are given only by the Sectors q > 2 and contribute 
positively to the free energy. 

Expanding the logarithm in Eq. (7.82), as we did in Chapter 4 with the Hessian 
in random graphs, we obtain 

A F 2 = lirn V TV J ( (7.85) 

n—► o f3n “ 27 y ’ 

The structure of 0(1/N) finite size correction, A F 1 + A F 2 , in the random link 
problem, is similar to the one we found in Chapter 4 for Ising models on Erdos-Renyi 
graphs. In fact, as clearly stated in Ref. [60], each nodes in the complete edge has 
only a finite number of low cost edges relevant for the optimal matches. Therefore 
the complete graph is well approximated with a Poissonian random graph with finite 
connectivity. The 7 = 2 term in Eq. (7.85) is cancelled out by a corresponding term 
in AF\. Therefore the total finite size correction A F = A F 1 + A F 2 is ultimately 
due to two factors. The first, corresponding to the term 7=1 in Eq. (7.85), is due 
to the fluctuation on the number of edges in the Poissonian graph. The second, 
corresponding to the terms 7 > 3, is given by the presence of simple loops of finite 
length. Last proposition is confirmed by previous arguments and comparison of Eq. 
(7.85) and Eqs. (7.15,7.31) for the Euclidean matching problem. 

We have thus established the connection between finite size correction in the mean 
field matching model, i.e. the random link problem, and the polygonal correction to 
the Bethe approximation of the leading cost in the Euclidean version of the problem. 

7.5.2 Anomalous scaling behaviours 

Let us consider again the random link problem. We will show how we can derive an 
anomalous scaling for the second order correction to the thermodynamic free energy. 
We express the average optimal cost as 

e RL (lV) = e 0O + e i^ + °(^) • ( 7 - 86 ) 

2 

For p(w) ~ 1, corresponding to the case d = p in the Euclidean matching, eoo = j 2 
[18]. For simplicity we will stick to this case, the argument is general though. 
Following the discussion of previous paragraph we approximate the e\ with the 
contribution given by loops. According to Ref. [95] we have 

o *T<YiJ dtTlH ^ (7 - 87) 

£ odd 

where 

G(u ) G(v) 

Ht(u, v) = e 2 2 ~ 9(u + v — 2t) (7.88) 

Once again we stress the equivalence between last equation and the operator 
of Eq. (7.58). We approximate traces with powers of the leading eigenvalue of H t 
we arrive to the expression, as we did in Section 7.4. Since for large 7 the integral 
is dominated by the region of small t, we can use the asymptotic form A (t) ~ e~ at . 
Integration in t in Eq. (7.87) than yields 
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Fig. 7.2. Average optimal cost in the monopartite random link matching as a fuction of 
N. The subsubleading scaling has an anomalous 0(N~ 2 ) behaviour. 


ei ~ c ( 7 - 89 ) 

e>3 1 
i odd 

where c is some constant. 

Since the probability for a random path of length £ in the complete graph to 
intersect itself is 0(£ 2 /N) for large i and N, therefore we expect a correction to last 
formula that can be as expressed in terms of a regularizing function, J21 >3 

i odd 

Equivalently we can introduce a cutoff A = \/~N on the series, and write 

«§? = «•+o(^)- <™°> 

i odd 

Therefore the asymptotic expansion of the average optimal cost in the random 
link problem takes the form 

e Rh{N) = e-oc + e iT 7 + e ?— 3 ~ T o f —3 ] . (7-91) 

We have thus individuated a subleading correction with a non trivial fractional 
exponent. This result is confirmed by numerical simulations as shown in Figure 
7.2. Fit of numerical data give ei = 0.063(3) and ez = 1.35(6) for exponentially 

^ 2 

distributed costs, whereas the leading value, as computed in Ref. [18], is 
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Fig. 7.3. Average optimal cost in the Euclidean matching problem as a function of L = y/JSf 
for d = 2 (left) and d = 3 (right). Numerical data do not allow for a definitive validation 
of the subsubleading scaling behaviour. 


A similar argument can be used to compute a finite size correction in the 
Euclidean matching. In this case the loops contribute to the leading order energy 
approximately with 


c 


E 

£>3 
£ odd 


i 

£ 2 +F 


(7.92) 


We now impose a cutoff A. Some simple considerations will allow us to find its 
scaling with N. In fact from Eq. 7.30 we see that dimensionally [fc] = \t~ 2 . At finite 
size the integration over k in Eq. (7.31) is replaced by a sum over the Fourier modes 
corresponding to the box [0, L\ d , with L = Na since we rescaled the original unit 
box. Therefore the cutoff A has to scale as A ~ kf^ in ~ L 2 , and we have 


A 

E 

£>3 
£ odd 


l 2+ l 


= c 


£ odd 


+ o 


\L d+ 2 


(7.93) 


According to this argument the optimal cost in the Euclidean matching problem 
should scale as 

e d(N) = e d + Ad-^2 +° (^+2) ' ( 7 ‘ 94 ) 

Unfortunately numerical simulations contradicts this scenario. In dimension d = 3 
and with flat cost exponent , p = 1, we averaged the optimal cost over 10 6 to 10' 
samples for each size of the box L = 8,10,12,..., 22 and with N = L d points. The 
results are clearly incompatible with the scaling 1/L 5 from of Eq. (7.94). It turns out 
our data is compatible both with a fitting function of the form e%(N) ~ a+b/L 3 +c/L 5 
and one with the form ed(N) ~ a + b/L c . This results are presented in Fig. 7.3 and 
Table 7.1. 

The 0(1 /L d+2 ) correction we have highlighted is overshadowed by a slower 
correction coming from some other mechanism, possibly O (1/N ). In any case the 
presence of non-exponential correction to the leading order energy is per se an 
unusual feature for a finite dimensional system, denoting a critical behaviour. 
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d = 3 

a 

b c 

e(N) « a + b/L A + c/L b 
e(N) « a + b/L c 

0.317010(1) 

0.317009(1) 

0.033(2) -0.5(1) 

0.009(2) 2.5(1) 


Table 7.1. Fitted parameters from numerical simulations on the EMP with N = L d points 
and flat distances (p = 1). 


7.6 Conclusions 

We performed a detailed replica calculations for the average cost in the Euclidean 
matching problem. We expanded upon the work of Parisi and Mezarcl [58], which 
considered only correlation in the costs of links forming triangles, including all 
the cost correlations on simple loops. The approach we took is based on the 
diagonalization of a replicated transfer matrices in the irreducible subspaces of the 
replica permutation group. This approach is the same used in Refs. [13] and [95] 
to compute the 0(1/N) finite size correction to the random link matching problem 
trough the diagonalization of the Hessian. For the leading order in N of the EMP 
our computations gives the result 

e d ~ e M F + o iP'Hi (7.95) 

£>3 £>3 

£ odd 

where e MP is the mean held term computed in the random link (i.e. independent 
weights) approximation, T^ is the contribution from the Longitudinal and Anomalous 
Sectors degeneracy in the loops of length £, and fid the contribution from the other 
Sectors, which is null for even lengths. Additionally we showed how to efficiently 
compute the terms Yli and although some analytical progress can still be done 
for r £ . Finally we proved the equivalence, up to a simple Fourier mode dependence, 
between the terms and the terms appearing in the 1/N computation in the 
random link problem as computed by Parisi and Ratieville [95]. 

The work presented in this Chapter is incomplete, although the great part of 
the expected results have been achieved. A more in-depth analysis of the term Yu 
is needed, and also analytic results have to be confirmed by numerical simulations. 
We will address these deficiencies in the following months. 

In the long term perspective, we expect that the terms in the Euclidean replicated 
action which are of higher order in the in the number of cycles are in one-to-one 
correspondence to higher order terms in the O (1/N) expansion of the random link 
matching problem. 

The results of this Chapter nicely fit with the discussion of the 0(1 /N) finite 
size corrections in diluted random graphs of Chapter 4, characterizing simple loops 
contributions to the free energy, and with we present in the next Chapter on the 
large M expansion. 
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Chapter 8 

The Large M Expansion 


8.1 Introduction 

Analytical investigation of finite dimensional disordered systems is a difficult challenge 
for physicist, scholars relying on uncontrolled renormalization schemes [188-190] 
and facing diverging (already at the first order) perturbative theories [191]. 

Fully-connected mean field models would constitute a solid starting point for 
perturbative expansions, but they could fail to capture qualitative feature of finite 
dimensional systems [192]. Another class of mean field models, possessing some of 
the feature of real systems, is that of diluted random graphs. As already discussed 
in Chapter 2, diluted graphs, being locally tree-like in the thermodynamic limit, can 
be investigated through the use of Cavity Method, which we will also call Bethe 
approximation (although generally this name indicates the Replica Symmetric Cavity 
Method). 

Many attempts to perform systematic expansion around the Bethe approximation 
where produced in recent years, namely those of Parisi and Slanina [193], Chertkov 
and Chernyak [167,168], Montanari and Rizzo [157,194] (can only compute corrections 
to marginals), Mori and Tanaka [195,196]. While some of this attempts are very 
promising [167,196], they where conceived to be applied to single realizations of the 
disorder, therefore it is difficult to see how to use them to compute disorder averages. 
The other schemes are plagued by infrared divergences [193] or are algorithmically 
oriented and limited to the computation of marginals and not free energies [157]. 

In this Chapter we contribute to the literature developing a formalism to system¬ 
atically perform a perturbative expansion around the Bethe free energy for disorder 
system in finite dimension, which we call large M expansion. We will employ a 
combinatorial technique to interpolate between an arbitrary finite graph and a locally 
tree-like graph infinite graph, for which the Bethe approximation holds true. 

We will make use of both the Replica and the Cavity Method in our computation. 
The replica computation is similar to the one performed in Chapter 4, but it is 
slightly more involved, since we have also to address an 7/(1) symmetry giving some 
null modes. This work is at an early stage, therefore the results we presents are 
incomplete. Some additional effort is required in the future to polish the formalism 
and explore its applications. We will see though that the work we reported in 
Chapter 4 on the the finite size correction in diluted random graph is a valuable 
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Fig. 8.1. Pictorial representation of the M layer construction. The rightmost figure 
outlines a simple loop in the M-graph, corresponding to a non-backtracking closed path 
in the original lattice. 


guide for the large M expansion. 

8.2 The model 

Here we introduce the general idea of our large M expansion. Let G = (V, F, E) be 
an arbitrary factor graph, with V and F its variable and factor nodes set respectively, 
and E its edge set. To each node i £ V we associate a variable Xi taking values 
in a set X having finite or infinite cardinality. To each factor r £ F we associate 
a random interaction ip(xi : i £ dr : J r ), where J r is some parameter encoding the 
realization of the disorder. The partition function of the system is given by 

z(J) = E n ip(xi :iEdr; J r ) (8-1) 

x r£F 

We then create M copies of our system. We will refer to the different copies as 
layers and label them with the Greek letters a, beta = 1,..., M. Each variable of 
the new system is then labelled by a couple (i, a), with i £ V, a 6 [M], We consider 
for each layer a a different realization of the disorder J a . The partition function of 
the whole system is trivially 


M 

z(Ji) x ■ ■ ■ x z(j M ) = e n n V>( Xi a : i G dr ; J ra )• (8-2) 

X1...XM q= 1 rS-F 

Now we introduce the main ingredient of the construction. For each link (r, i) E E 
define a permutation n r i of the labels a = 1 ,,M and rewire the links according 
to these permutations. The partition function of the new system is thus given by 

Z M ({ J q },7t)= : * G dr,(3 = Tr ri (a);J ra ). (8.3) 

{x a } Q r 

We refer to the M graph as to the factor graph underlying the partition function 
Zm- The free energy of the model is defined as 

Fm = --^EjE n \ogZ M ({Ja},^) (8.4) 

Alternative definitions can be considered for Fm , exchanging quenched averages 
with annealed averages or sampling the same disorder for each of the M layers. 
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J 

Fig. 8.2. Average energy for the RFIM at zero temperature on the square lattice d = 2 
and L = 16. The values extrapolate to the energy of an infinite random regular graph 
with connectivity z = 4. 


Setting M = 1 in Tm we trivially obtain the average free energy T of the original 
model. More thought is required to understand the M | oo limit. 

The infinite computational tree of the graph is sort of "unfolded". 

We resume the previous considerations in 


T\ = T, lim T M = -^Bethe- (8.5) 

M —>-+oo 


We now assume that Tm has a regular 1/M expansion around the point M = +oo, 
to write 


Tm 


+oo 

Bethe E A-k 

k=1 


1 

W' 


( 8 . 6 ) 


We have thus produce a perturbative expansion around the Bethe free energy for 
any given factor graph (see Fig 8.2). Notice that we did not take a large graph limit 
in order to produce it. Generally the limit N f oo and M f oo do not commute. 


8.3 Replica Calculation 

Here we discuss ho to apply the replica method to compute the large M expansion 
for the Ising model on an arbitrary graph G = (V, E). The Hamiltonian appearing 
in the random partition function Zm is given by 
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M 

'HmVt] = - Z Z c ?f viaVjP -EE^ ( 8 - 7 ) 

ot,f3 =1 (ij) a i 

with i.i.d. couplings and fields hf. They elements of the adjacency matrix 
C°f of the M are induced by the uniformly chosen permutation of the links. Their 
joint probability distribution is factorized on each edge (i,j), and is given by 

P(C) = I] P(Cij) (8.8) 

Oh) 

with 

e (s.9) 

■ {C“/3=0,1} a \ p J P \ a / 

We notice that these are exactly the constrains defining a bipartite matching. In 
order to perform the quenched average over coupling, Reids and the realization of 
the M graph, we have to replicate the system. The replicated Hamiltonian is then 
given by ]C”=i T~^M[v a ] and the replicated system will contain n x N x M spins af a . 
As usual we will often suppress the replica index from now on.The computation of 
the replicated partition function is very similar to the one performed for the RRG 
in Appendix B.l, therefore here we will skip some of the passages. After introducing 
the Lagrange multiplicators A■ to open the Kronecker delta in V( C) we obtain 


yn _ 7 


e nn 

(j-H) Q 


dA: 


i—>j . 

° g l— 


27 r 


n 


0 H ((Ti a ) 


x nri e 

(i,j) 


log I l + e Xi ~>j U(<j ia ,o :j p)e X i^ i 


( 8 . 10 ) 


The functions U(a,r) and H(a) are defined by 

U(a,T) =E je J SLi CT ^ a ( 8 . 11 ) 

e H G) = ^ h e h YZ=i° a ( 8 . 12 ) 

As we will later check we can expand the logarithm just to the first order around 
one. In fact higher powers are suppressed by the A integrations. Therefore we have 


yn — ^ 

M (M!)I e I 


e nn 


dA: 


i—>j —i\? 

J g l—t] 


2t r 


i.a 




X IT e ^“’ 

(*>i) 


E„fl e ’ U(a ia ,a jP )e ^ 


( 8 . 13 ) 


Defining for each directed link the function pi^j(a) through 

Pi^j{a) = ~ &ia), 

a 


( 8 . 14 ) 
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using the relation 

e f uUv = e f l( u + v ) u { u + v )~l f (u-v)U(u-v) 


f dj dy j x jj 1 x—J yU 1 y+f u(x+iy)+ J v(x—iy) 


(8.15) 


J ir det U 

and integrating out the lambdas we obtain 


yfr _ 1 ST [ Tl (1 /'/ yd/b • ; Jp^u^f. 

M ^ J , , n 2 " detU 


n ia ) n Pj^i( a jp) n 


0 H(a ia ) 


(8.16) 


The integration variable pi^>j are complex and such that Pi^j = Pj^i- We can 
now sum over the spin configurations. We make the change of variables pi^j(a) = 
VM f U{a,T)pj^i{r). Notice that we inverted the site indexes, to obtain more 
meaningful message passing equations at the saddle point, as we will later show. 
The equation for the replicated partition function now reads 


— _ I" M m M 2 " det U 

M ~ ^Ml 


n [d Pi^j d Pj-*i] 

(hi) 


-MS\p\ 


(8.17) 


with the action 5[p] defined by 


s [p\ = y dcdr Pi^j(a) U(a,r) pj-h(t) - ^log J da e H{a) [ J Up k ^i](a). 


(8.18) 


We notice that the action is invariant under a complex rotation of the fields 

Pi^j(a) -s- Pi^j{cT)e l6i ^ j , (8.19) 

with Oi^j = since the two field a re complex conjugate. In order to integrate 
over the orbits we can introduce for each edge the constraints 

27t J d rij rij 5 ^ ^ pi^j(a ) - S^^pj^a) - (8.20) 

rescaling the fields p by a factor we can integrate out the r t j. In fact after the 
rescaling the r dependent part for each edge is given by 

2vr J drij '< /''< W,, ,.2.u = ^^+2^ e -(M+2»)io g /^^ i 

( 8 . 21 ) 

At this point we finally arrive to 


_ _ + 2 n ) det U 

— „2 n AT I 


1 1^1 r 

J dp 5 (J2p- l) e“ MS[p] - ( 8 - 22 ) 


The integration measure and the delta function in last equation stand for 

d/ 3 P ~ 2 ) = II d/t \jdpj S( Pi^i( a ) - !) H Pi^ a ) ~ l) • 


(8.23) 
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The action S[p\ is defined by 


S\p] 



(8.24) 


The learned reader will recognize at this point that S[p] has the form of the Bethe 
free entropy, we will later see that at the saddle point the function pj^i{a) will 
correspond to a distribution of cavity fields hj->i. 


8.4 RS Saddle Point 


We proceed to the saddle point evaluation of the action, subject to the constraints 
5(J2p — 1). For the time being we ignore the constraints, we will later see that 
there exist a set of pi^j satisfying the unconstrained saddle point equation that is 
compatible with them. Let us define 


Pi-yj{c r) = J dr U(a,T)pi^j(T) 
The saddle point conditions for M —>• oo, ds , = 0, give 

OPj—ti {O') 

/ Upi^j(a) J Ue H{a) IlfcedAi Pk^i(&) 
I pi^fj U Pj^-i J n k£di Pk^fi 

which can be otherwise stated as 

Pi^j{<r) = eH(a) Uk&di\j Pk^M) 
I Pi yj U pj — yi J e H n kedi Pk^fi 


(8.25) 


(8.26) 


(8.27) 


We see that given a solution {pj^i} of last equations, we can multiply each function 
Pj^ri for a different arbitrary constant and obtain a new solution. This scale 
invariance is destroyed thanks to the constraints Pj->i( a ) in Eq. (8.22), which, 
by the same scaling invariance property, can always be met by the unconstrained 
saddle point. Here we consider the Replica Symmetric approximation. In this case 
the value of p^j(a) depends only on the sum of the J2a=i °' a - As usual we can 
parametrize the order parameter at the saddle point with a function P{h ): 


Pi^j{a) = dh 


(2 cosh {3h) r 


(8.28) 


For each value of n the normalization condition implies / d hPi->j(h) = 1. In the 
n —> 0 limit the saddle point equations (8.27) become the distributional cavity 
equation 


Pi-+j(h)= E h / II d Q k ^(u k ) 6{h-(H+ £ u k )) 

k£di\j k£di\j 

Qi^j(u) =Ej J dPi^j(h) S(u-u(J,h )) 


(8.29) 
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Inserting previous two equation in the action (8.24), we finally obtain 


with 


lim Tm = Bethe 
M —>oo 


ftP Bethe — 4>ij + ^/(l — |<9?’| 

(hi) i 


(8.30) 

(8.31) 


The edge and site free entropies are defined by 


4>ij = << In [4cosh(/ii_>j) coshcosh( Jij)(l + tanh (hi->j) tanh(/ij_ > j) tanh(Jjj)] >> 

(8.32) 

and 


(pi = « In |^2 cosh(i/i + ^ Uk- 

k£di 


» 


(8.33) 


8.5 The 1/M term 

The computation in the replica formalism of the 1/M term, that is the Gaussian 
contribution to the action, poses some technical difficulties that we did not manage 
to overcome yet. The presence of the constraints in the partition function 8.22, 
ultimately due to the gauge invariance, kill the corresponding directions in the 
functional space, therefore we have to change accordingly the base in order to compute 
only the relevant fluctuations. The presence of a Gauge invariance is common to 
all the problems involving bipartite matching, therefore was not encountered in the 
ER and RRG finite size corrections of Chapter 4. This problem was encountered 
also in Ref. [156] and [95] when computing the 1/N correction to the random link 
matching problem. In that case though, they could bypass the problem not including 
the longitudinal sector contribution in the diagonalization of the Hessian, since 
that sector is exactly the one suppressed by the constraints. Since we don’t want 
to proceed to the direct diagonalization of the Hessian but we want to retain our 
physical interpretation for the correction to the free energy in terms of closed and 
open chains, that road cannot be taken. The approach we plan to take exploits the 
formal limit 


5 [y p^Aa) - 1 ) = lim — e-E^^W- 1 ) 8 . (8.34) 

V'v J 2vre 

Therefore we add some extra Gaussian terms to the action to suppress longitudinal 
fluctuations. Note that using the integral representation of 5 (J2cr Pi^j( a ) ~ 1) using 
a Lagrange multiplier would give null modes in the Hessian as well. 

We did not complete yet the replica calculation of the Hessian, therefore, for 
the time being, we leverage the result obtained in the diluted graphs to obtain the 
expression for the 1/M term we where looking for. 

We assume that we deal with a regular lattice in dimension d, with periodic 
boundary conditions. In this case the solution to the saddle point equation is 
homogeneous, 


Pi^j{a) = p(a) Pi^j{h) = P(h) 


( 8 . 35 ) 
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and the asymptotic free energy is exactly the same of RRGs with connectivity 2d. 
Writing the expansion of the free energy as 

Em = F Bethe +AF—+ o (8.36) 

the first sub-leading order term in the expansion has to take the form 

AF = Y,/^ e A(j>t (8.37) 

e>3 

The coefficients A(f>g are exactly the same, qualitatively and quantitatively, as those 
computed in random regular graphs in Chapter 4. 


A(j>i = 4>e— £(<$ - 4>g-i)- (8-38) 

The coefficient AT#, accounting for the average number of loops in the graph, is not 
(%- 1} > as one wou ld expect in the RRG ensemble. In fact one convince himself 
that the average number of loops at the order 0(1/M) in the M —graph is given by 
the number of non-backtracking paths of length £, both simple and non simple, on 
the original lattice. If we define the 2\E\ x 2\E\ non-backtracking matrix B, indexed 
by the directed edges i —> j of the lattice, as 


— &lj( 1 $ik)i 

then the coefficient Ng is given by 


(8.39) 


(8.40) 


In order to compute Eq. (8.37) we approximate the free energy shift Awith 
the highest eigenvalue in the relevant sector of the replicated transfer matrix (see 
Chapter 3), that is 


A(j)£ ~ 


c x £\\ 

c 2 xi 


for the RFIM 
for the spin-glass 


(8.41) 


With this approximation, it turns out that the series in Eq. (8.37) can be exactly 
resummed, since we can compute the generating function for the number of non¬ 
backtracking walks, as we show in the next paragraph. 


8.6 Non-Backtracking Random Walks 

Let us first establish some notations for the number of non-backtackig walks in the 
infinite lattice Z d : 


be(x) = # NBWs of length £ from 0 to x 
b e (k) = Mx) e lkx k€[- 7T,7r] d 

x£Z d 

B z (k) = Y,h(k) z l 

e>o 


(8.42) 
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Notice that since we are interested in closed paths we have to compute 6^(0). We 
will use a result obtained in Ref. [197] for B z (k), the generating function of the 
Fourier transform of b((x). The authors proved the relation 

BJk) = --t-. (8.43) 

1 + (2 d — 1 )z 2 — 2 z l cos K 

We now show how to compute the generating function for A fg, that we call A(. This 
is related to B z (k ) by 

r c\^' ]c ^ 

= j ( 8 - 44 ) 

Using last two equations, some simple manipulations give 

f d d k 2 . f + °° , —t f l+(2d—l)z 2 —2z cos k L 

A{z)= !t 2w {l ~ z) L dte 


(27 
= (1 - ^ 2 ) 


r+oo 


d t e -i(!+(2d- 1 )* 2 ) [I 0 (2zt)} d 


(8.45) 


where I a (x) is the modified Bessel function of the first kind of order a. In two 
dimensions we have 


I< 


A(z ; d, = 2) = (1 — z 2 ) — 


16 z 2 


(3z 2 +ir 


7r 3 z 2 + 1 


(8.46) 


where K{x) is the complete elliptic integral of the first kind. 
More generally for every dimension d we have 


A(z) 


1 for z 

Too for z 


0 

i 

2d—1 


(8.47) 


The analytic knowledge of the generating function A(z) through Eq. (8.45), 
along with the results from the replicated transfer matrix theory of Chapter 3 that 
yield Eq. (8.41), allow to approximate the infinite sum of Eq. (8.37) to a high degree 
of precision. 


8.7 Conclusions 

In this Chapter we proposed a new perturbative approach around the Bethe approx¬ 
imation for finite dimensional disordered systems. The expansion parameter is the 
number M of layers in a auxiliary random lattice models. For M = Too we obtain 
an infinite RRG graph, to which all the machineries of Cavity and Replica Methods 
apply. The first contribution to the the free energy in a 1 /M expansion is computed, 
although the replica computations poses some problems yet to be addressed. The 
result for the coefficient A F of the 0(1/M) term 

AF = '52N‘ l A<i> e , (8.48) 

e>3 

appears to be sound, motivated by a cavity argument and by the results of Chapter 
4. Hopefully we will soon address the difficulties in the replica computation and 
investigate the analytical and numerical consequences of our approach. 
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Conclusions 


Along this thesis I discussed many different topics, strictly or loosely related. Here I 
resume and discuss briefly the results we achieved, trying to underline their common 
ground, and I invite the reader to refer to the conclusions of the various chapters for 
more specific discussions. 

One research line bridges the work on finite size corrections in diluted random 
graphs of Chapter 4 and Refs. [2] [3], with the large M expansion around the Bethe 
approximation that we proposed in Chapter 8. We can express the result we derived 
for the coefficient A/ of the 1/N and the 1/M terms in diluted random graphs and 
lattice models respectively through the unique formula 

A/ = 5>iAfc. ( 8 .49) 

e>3 

This formula relates the first correction to the Bethe free energy to the presence of 
simple (i.e. non-intersecting) loops. The factor <f>i here is the free energy difference 
due to the addition of a closed chain of length t to an infinite tree. The coefficient 
Mi is a combinatorial factor accounting for the average number of simple loops of 
length t. It takes value zr / (2£), with z the average residual degree, while in the large 
M expansion for finite dimensional lattices is the number of closed non-backtracking 
paths of length l in the lattice. The infinite sum in last equation can be computed 
with high degree of precision thanks to the replicated transfer matrix formalism we 
developed in Chapter 3 and Ref. [1]. A short term goal is to fix some issues, due 
to gauge symmetries, in the replica computation for the large M expansion, thus 
supporting with the replica formalism the result obtained through the probabilistic 
argument. In mid/long term perspective it would be desirable to find a general rule 
to express the free energy shift of a loopy structure to an infinite graph. An accurate 
comparison with Loop Calculus of Cherniak and Chertkov [167] is also needed. 
Finally, the large M formalism could help to shed some light on phenomena, such 
as the breaking of dimensional reduction in the RFIM [56], normally not captured 
by perturbative theories [57]. 

Another line of research is dedicated to the Euclidean Matching Problem, both 
in its monopartite (Chapter 7) and bipartite versions (Chapter 6 and Ref. [5]). As 
we discuss in depth in Chapter 6, bipartiteness as deep consequences for the optimal 
matching and the scaling behaviour of its cost, therefore the two problems require 
separate analysis. 

In the bipartite case, through a continuous approximation for this discrete 
optimization problem, we propose a (stochastic) Poisson equation relating a transport 
field and the density differences among the two set of points. The average optimal 
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cost can then be expressed as an infinite series, diverging for d > 2 , that we manage 
to regularize with an analytic continuation. In the end, in the case of quadratic 
costs, the following original results: 


f + ei d — 1, 

e d (N) ~ i^kilV + es d = 2, (8.50) 

{e d + C ~0N~^ d> 2, 

with 7 ^ = We see that the effects of set-to-set fluctuations captured by our 
approximation is dominant for low dimension, while for d > 2 gives an anomalous 
subleading scaling. Noticeably in our formalism the intensive 0(1) term can not be 
predicted in any dimension. We hope that similar techniques could be applied to 
other optimization problems as well. 

The approach to the monopartite problem in Chapter 7 is completely different. 
It is based on a replica computation that goes beyond the simple mean field approx¬ 
imation including the correlation among the weights of the link in simple loops. The 
expression we obtain is similar to Eq. (8.49). In fact, in relation to the 0(1/N) and 
0(1/M) expansion discussed above, analyzing the 0(1/N) finite size in the random 
link matching problem we managed to show a one-to-one correspondence between 
the terms appearing in the fully-connected model and the ones in Euclidean model, 
ultimately relating all to the presence of small simple loops. This Chapter represent 
another brick establishing the connection between finite size corrections in mean field 
models and perturbative expansions in finite dimensional systems. The perspective 
here as well is to compute the contribution of more complex loopy structures and to 
extract from the series the scaling of finite size corrections. 

Throughout these works the results for the Replicated Transfer Matrix of Chapter 
3 and Ref. [1] proved to be valuable conceptual, analytical and numerical tools. It is 
desirable to extend the formalism to the 1RSB scenario and to p-spin models. 
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Appendix A 

Appendix to Chapter 4.2 


A.l Coefficients ap 

The coefficients cil can be determined by computing recursively all the functions Sl ■ 
A little bit of thought should convince oneself that Sl is given by the probability 
of the event El = {L consecutive links are present}, by splitting it in at least two 
smaller events El 1 and El 2 with L\ + L -2 = L. Since pl = Probf-E/J it should be 
clear that qL = Pl — Sl is like a “connected” probability to obtain the L links from 
a unique structure. It is not hard to derive a recursive equation for the functions 
Sl, valid for any L > 2: 
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implying 


9i = ^ 1 “ 9fc = -T7 for fc > 2 . 


Rewriting eq.(A.2) as 


QL = (A: - L + 1 )a k + X c k , 


k=L -\-1 


we can obtain 


q L - qL+i= ^2 a k +°L+i =*> X afc = 9£ = “X VL > 2 


by noticing that cl = — qi for L > 3. Moreover, for L = 1 we have 


XI “fc = 9i - 92 = 2 ; + 


z 2 - ^ 


In conclusion the coefficients at, are given by the following expressions 


ai= z + — (2z 2 - z) , 

a L = i- T (z L+1 - z L ) for L > 2 . 
IV v ’ 


A.2 Combinatorics of Tr 


(A-10) 


Here we prove eq. (4.23), relating Tr in the small n limit to the free energies 
of open and closed cavity chains. Let’s rewrite our 2" x 2 n matrix as: 


T(<t, a') =;?e| 


l [2ch (/3h)]' 

1 

[2ch ((3h')} n 


> J E 


J d re J S/ aT “ +,l Ea T “j e^Ea^a | . 


(A.11) 


where expectation is taken over the coupling J and the cavity fields h, h 1 , which are 
distributed according to the solution of eq. (4.16). We immediatly note that the 
factor [2ch(/3/t)] n reduces to 1 + nlog2ch(/3Ai) + o(n), in the small n limit, allowing 
to rewrite T(a,a'), with o(n) accuracy, as: 


T(a,a') =zE _ (^j d e h 'E a < 


(A.12) 


+ nzEh log 2ch (/3h) + o(n ). 


We recognize that the term E[e' 7 ^-'t‘ 0 ' a0 '“+ /l E o 0 'a] is the replicated transfer matrix of 
a one-dinrensional chain, and so when we take the trace of T(a , a') we simply get: 

Tr[T] = —nfiz[4>\ — (</>“ +/3^ 1 E/ l log 2ch(/3/i)^] + o(n) . (A.13) 
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When computing the trace of T L , for L > 2, the term nzKf, log 2ch(/3h) in eq. 
(A. 12) gives only contributions of order o(n) and thus can be completely ne¬ 
glected in the following calculation. Let’s call A = Eand 
B = E[^/dre J ^«' T “ T ° +,l S« T “J e h '^a <7a ]. The product T L is formed of a linear 
combination of all the possible products of L matrices chosen between A and B, 
therefore we now consider the traces of such products. A simple inspection shows 
immediately the Tr ( A L ^ is nothing else that the replicated partition function of a 
cavity loop, that is a closed chain of length L embedded in a locally tree-like random 
graph. Consider instead a term with one insertion of the matrix B, Tr A ... ABA 
Since B is factorized, its insertion prevents the closure of the chain and we obtain 
the replicated partition function of an open cavity chain of length L. Generalizing 
the argument we can see that the trace of a product containing k matrices B yields 
the product of k replicated partition functions of open chains, whose total lengths 
adds up to L. Since in the n 0 limit products of partition functions become the 
sum of free energies, we can write 


^ Tr (T L ) = -/3z l [ <t> c L + £ bi ] + o(l), (A.14) 

where the coefficients bi have to be determined. It is easy to see that bi = —L and 
i = L, while a simple combinatoric argument gives the remaining coefficients. We 
can construct an open chain of length l < L —1 in the first l+l positions of the product 
and than multiply for the L possible ways of obtaining the same trace. So we consider 
products of the form BA l - 1 Bx{2 L ~ l ~ 1 different combinations of A and B}. Taking 
into account the number of insertions of B in the last L — l — 1 positions we obtain 

b l = Lx E =° f° r 1<L-1, (A.15) 


which immediately yields eq. (4.23). 
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Appendix B 

Appendix to Chapter 4.3 

B.l Integral representation of [Z n ] av 

The average of the replicated partition function of the model reads: 


\z n U = 


y | n ex p ( p j i3 c n y a t a j n ex p y 

|_{cr} \i<j \ a= 1 / i \ a= 1 



(B.l) 


where the sum has to be taken over the replicated spins {af } for i = 1,..., N and 
a = The average [ • ] av has to be performed over the RRG ensemble, 

the couplings Jij and the random fields Hi. The graph ensemble is defined by the 
probability of sampling one of its element, having adjacency matrix C t] . This is 
given by 




i<j 


1 - - ) S(Cij) + -SiCv - 1 ) 


N 



(B.2) 


Here the variable c is the connectivity of the nodes, the weighting factors 1 — and 
jj have been chosen for convenience and A is a normalization factor. Let us define 


U(a i ,a j ) = E J (f J Z a °> c 3 
B(<Ji) = log Eh (e l3H Za 


(B.3) 


The arguments of the functions U(<Ji,<jj ) and B(oj) indicate the replicated spins 
Uj = (ul,..., u”). When it can cause confusion, the replica label a will be explicitly 
written. 

After averaging over the graph ensemble [198], Eq. (B.l) takes the following 
form: 


1 

A7 


M 


f (n dA * e~ iXiC+B ^ 

| exp < 

[e 1o s 

1 + Jf( eiXi U(<T i ,<r j )e i ^-l) 

3 V i ) 


[i<j 

(B.4) 
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where we used the integral representations of the Kronecker (5-functions appearing 
in V(C): 


(B-B) 

We expand the argument of the exponential in Eq. (B.4) to obtain 


E lo s 

i<j 




(e^Uia^a^ 


j _ i 


Js- 


+ 




\2N 2 N 2 

J2e 2lX 'U(ai, 


J2e iXi U{ 


<Ji,aj)e lXj 


c 

2N 


Vi 


4 N 2 


^ e 2iXi U 2 (<Tj 


i, Vj)e 2iXj 


v 


+ A(N, c) + 0 ^ > 


where the constant A(N, c ) is given by 


,,, T X cN c c 2 
^ C ) = -^ + 2- 4- 


(B.6) 


(B.7) 


In order to compute the sum over the spin variables in Eq. (B.4), we need to 
decouple the sites. Site factorization can be achieved by introducing two functions 
pi (a) and p 2 (a), defined as 


1 




V,; 


*(') = * 11^-*?)> 


(B.8) 


if we are interest only in the first correction in ^. To obtain higher orders in the 
expansion we would need up to c different functions Pk(v), as will be clear from what 
follows. Using pi(a) and p 2 (a), along with the expansion (B.6), Eq. (B.4) becomes 


[ z ”]av ~ ex p{^T ( 1 + 'n) j dc7dr Pi(°'M ( b r )/ 9 i( r ) 

+ IV log J —— dcr exp[-ic\ +B(a) - ^e 2tX U(a,a)] (B.9) 
- C —J da dr p 2 (a)U 2 (a, t)p 2 (t) + A(N, c) - log Afj, 


up to the order 0(1). In the previous equation the notation / da stands for: 
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We note also that the function U(a,a), evaluated on the same first and second 
arguments, is independent on a. To lighten the notation we then define: 


U(a,a) =Eje n ^ J = U 0 . 


(B. 11) 


Proceeding in the calculation, we introduce two 5-functionals to enforce the 
definitions of pi (a) and p 2 (o’): 
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Vp k S 


Pk(cr) 


1 V f> ikX i 
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itk 



for * = 1,2. (B.12) 


The functional measure Vp is defined as Vp = n<reiR n dp(o-). Moreover, we use the 
following integral representation of the 5-functional: 


5\p) = J Vp e~f dt7 


(B.13) 


where Vp = rio-eR" d 2 ^ > t° rewi 'ite the replicated partition function (B.9) as 




n 'DpkVp/^J exp j -IV j 


do- pi(cj)pi(<j) 


\k= 

Nc 


+ — ^ + — J J do-dr pi{a)U{a,T)pi{r) 

- J do- p 2 (a)p 2 (a) - C — j do- dr p 2 (a)U 2 (a,T)p 2 (r) 

/ r (-1 \ p2iA / 

do- e s(<j) J — exp pi(a)e lX - icX + — \^p 2 {a) 
+ A(N,c) - log A/'}. 


cUo 

2 


(IhlD 

We now can carry out the A integration, expanding the exponential and obtaining 
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(B.15) 

In the sum on the r.h.s. of Eq. (B.15) we retain only the leading terms, corresponding 
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to m = 0 and m = 1. The partition function (B.14) now reads 


Vp k Vp k J exp l — N da p 1 (a)pi(c 


+ T : ( 1 + ^) / dcrdr Pi( <T ) u ( <T ’ T )Pi( T ) - j dcr P2(o-)p2(a) 
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+ A(N,c ) — logAA — IV log c! 


At this point it is natural to define a new field r{a) as 


r(a) = c 


2 fda e^p^af - 2 
J da e B ( a )pi(a) c ’ 


(B.16) 


(B.17) 


and to observe that the integral over p 2 (a) gives 


J Vp 2 exp dap- 2 (a) p 2 (a) - C ^ - r(a) | = S p 2 — ° ^ - r . (B.18) 


Integrating out also p 2 , we obtain 
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The integral over p\ is Gaussian and can be performed explicitly and we get: 
[Z n } av ~[det (cU)}~ 1/2 J Vpi exp | - ^ J dcrdr ,3i(a)l7 _1 (a, r)pi(r) 

+ A log f dcr e^^p^a) 0 + ^ /dadr pi(«t)C/ _1 («t,t)pi(t) 

2 ^ ^ (B.li 
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(B.19) 


da ?’(a) 


+ A(N,c ) — logAA — IV log c! 


We make the following change of variables, introducing at last the order parameter 
p(a) through 

pi(a) = c J da U(a, t)p(t), (B.20) 
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which redefines also the field r(<r) as 

e B{a) [/dr U(a, t)p(t )] c ~ 2 


r(a) = 


f da e B ( rr '> [/ dr U(a, r)p(r)] c 


(B.21) 


The computation of the factor logA7 can be done among the same lines of the 
preceding derivation, and gives [198]: 


c 1 log 2 

logAA ~ lV(clogc — logd -c ) + 2 + 4 -y ' 


(B.22) 


Calling for brevity A(N, c ) the quantity 


A(N,c) = A(N,c ) + IVc log c — IV log c! — logA7 
Nc c 2 + 1 i log 2 
“ 2 


4 + 2 ’ 


(B.23) 


we obtain the final expression of the [ Z n ] av up to the order 0 ( 1 ), that is 
[Z n ] av ~ [det(ct/)] 1 / 2 e^ (iV ’ c) J Vp 


(B.24) 


Here the integration measure is given by Vp = TlcreR" 47 ^ > and the functionals 
S{) [p] and 5i [p] read 


So[p\ = | j da dT p(a)TJ(a, t)p(t) - log J da e B{ - a) J dr U(a,T)p(r) 
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(B.25) 


B.2 Computing the finite size corrections 

There are two sources for the 1/N finite size corrections to the thermodynamic 
free energy density. The first contribution comes from the subleading part of the 
replicated action <Si[p], evaluated in the saddle point solution p*, given in eq. (4.57). 
The second one stems from the Gaussian integral obtained by expanding the leading 
action Sq\ p\ around the saddle point. This is given by 

[det {cU)} 1/2 J V X e-^f xd2s ° x = e -!i°gdet(i-s/ (B.26) 


where %(u) is the rescaled fluctuation of p(u) around the saddle point and we omitted 
the dependence on the replicated spins in the exponent of the l.h.s.. The matrix 
E(u, r) is defined as 


E(cj, r) 
T(a, r) 


(c- l)T(u, r) - c 


du' U(a, u')p*(u') 




U(a,r )r*(r). 


(B.27) 
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Summing up all the contributions, the averaged replicated partition function [Z n ] av 
up to order 0(1) becomes: 


[Z n U ~ exp 


A(N, c ) - NS 0 [p*\ - «5i[p*] + 



(B.28) 


The introduction of the auxiliary matrix T(a, r) will simplify a lot the computa¬ 
tion of the trace appearing in Eq. (B.28). The crux is to observe that p*(a) is a left 
eigenvector of T(<r, r) with eigenvalue 1, i.e. 

J do- p*(<7 )T(a, t) = p*(r). (B.29) 

This property can be verified by acting on the left with T(a, r) on the saddle point 
equation (4.57). 

It is useful to define also an auxiliary function p*(cr) as follows: 

P*{p) = JdTU{<,,T)p.{T). (B.30) 

As a consequence of the saddle point equation (4.57), the function p*(<r) has the 
following interesting property: 

J da p*(o-)p*(a-) = 1. (B.31) 

Using the definition of T(a, r) and p*(<7), the matrix E(er, r) can be cast in a simpler 
form, that reads 

S(ct, t) = ( c - l)T(o-, r) - cp*(a)p*(r). (B.32) 

The two matrices T(a , r) and p*(o-)p*(r) in the r.h.s of Eq. (B.32) they do commute 
with each other, as can be checked by inspection. Therefore, the trace of the 7-th 
power of the matrix E can be written as 


TrE <? 



(c- !)'-*(-c)‘rv ( hP,) h T‘- k 


(B.33) 


Observing that in all the terms of the sum, but the one corresponding to k = 0, the 
matrix T is multiplied on the left by its left eigenvector with unitary eigenvalue, we 
easily get the following result: 


Tr 
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Tr T l for k = 0 
1 for A: A 0- 


We can now immediately evaluate Eq. (B.33) and we find: 


Tr E^ = (c — 1)^ 


Tr T l - 1 




Inserting Eq. (B.35) into Eq. (B.28) we get 
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(B.34) 


(B.35) 


log 2 
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(B.36) 
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The term <Si[p*] can be expressed using the matrix T in the following way: 

Si Ip*} = [Tr T 2 - l] + ^ [Tr T - 1] . (B.37) 

Therefore we see that the terms £ = 1 and t = 2 in the sum in Eq. (B.36) cancel out 
with the terms coming from 5i[p*]. Moreover, using the definiton of A(N,c), and 
the noting that 5o[p*] equals 

So[/0*] = \ -iog^dcr e B{a) J dr U(a, r)p*(r) , (B.38) 

we finally obtain 

[Z n ] av ~ exp | IV logy dcr e B ^ J dr ?7 (ct,t)p*(t) + ^ ^ ^ ^ TrT £ -l |. 

(B.39) 

We split the free energy density f(N ) into the sum of the leading term plus the 
1/N correction: 

f(N) = f 0 + ^fi + o(l/N). (B.40) 

The quantity f\ is given by 

1 OO / _ -j 

A = - S &g (B.41) 


B.3 Evaluating Tr T f 


The matrix T(a, r) is defined as T(a,r) = U(a, r)r(r). In the replica-symmetric 
regime, we can parametrize the field r(a) as 


r(a) = dr R n {r) 


[2 cosh(/3r)] r 


(B.42) 


where the density R n (r) is non-negative and normalized to 1 in the limit n —> 0. In 
order to compute the 0(1/TV) correction to the free energy, we need also to compute 
its normalization up to order O(n). Inserting the parametrization (B.42) in the 
equation defining r(<r), i.e. Eq. (B.21), and considering also the n-dependence of 
the distribution P n (h) parametrizing p(cr), we obtain 


J dr R n (r) = 1 - nEj^log 


cosh(/3J) cosh(/r + /3u) 
cosh(/3r) cosh(/3w) 


+ 0{n 2 


(B.43) 


The random variable u is called a cavity bias and is drawn from the distribution 


Q(u) = Ej J dh P(h ) 5[u — u(/3, J, h)], 


(B.44) 


with P(h) solution of Eq. (4.59). In Eq. (B.43) the random variable r is distributed 
as R{r) = limrc^o R n (r), solution to Eq. (B.21). 
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With this considerations in mind, the matrix T(<r, r) can be written, for small n, 


as 


T((t,t) =E J>r 


exp (f3Jcr a T a + /3rr c 

2 cosh (/3J) cosh (/3r + (3u) 


La=l 

- nEj )T . )U log 


cosh(/3tt) 


(B.45) 


+ 0(n 2 ). 


The first term in Eq.(B.45) is the replicated transfer matrix of a 1-dimensional 
disordered Ising chain with random couplings J and random fields r. Let’s call 
T n («j, r) this first term. 

The second term in Eq. (B.45) is proportional to the thermodynamic free-energy 
density 4> of an Ising chain with random couplings J and random fields r [138] [1], 
explicitly: 


E J, r ,u log 


2 cosh(/3 J) cosh(/3r + /3u )' 
cosh(/3«) 


-M- 


(B.46) 


The full matrix T(<r, r), in the limit n —> 0, then becomes: 


T(a, t) = T n (a, r) + + 0(n 2 ). (B.47) 

Taking the trace Tr ^ we find 

TV T £ = Tr T £ + ntp<!> + o(n 2 ). (B.48) 

Now we observe that 

lima* TV T l n = -Ml (B.49) 

n—>-0 

where is the free energy of a closed chain (loop) of length l. receiving a held r on 
each of its vertex. Eventually taking the derivative and then the limit n —> 0 of the 
full trace Tr T , we get 


lim d n Tr T £ = —/3 (0S — £(j>) = A cf>(. (B.50) 

n —>0 

Coming back to the equation (B.41) for /i, and substituting the previous result 
(B.50), we finally obtain the formula given in the main text: 
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Appendix to Chapter 6 


C.l Evaluation of 

In this appendix we will show that, in dimension d > 2, the function 

«») = E As. (c.i) 

nez d \{0} H n ll 

a particular Epstein zeta function defined for Re s > |, analytically continued to 
the point s = 1, takes the value of E^ defined in Eq. (6.22), i.e. Cd(l) = E<^. Then 
we will derive an easily computable representation of the analytic continuation of 
(d(s) which was already presented in the literature [180,199]. 

Let us fix d > 2 and a > 0. Then, for Res > |, we can rewrite Eq. (C.l) as 
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(C.2) 


Assuming that the limit in the last equation exists also for Re s < |, we have isolated 
the singular term. The analytic continuation of ( d (s) then reads 
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R —>-+oo 
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(C.3) 


where to limit a —>■ 0 has been taken. Note that, comparing the previous equation 
with Eq. (6.22), Cd(l) = E d ■ On the other hand, for Res > f 


C d(s) 
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nEZ d \{0} 


1 
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(C.4) 
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where Q(z) is defined by Q(z) = J2n=- oo e 7 ™' 2z = where i?(r; z) is the 

Jacobi theta function. Noticing that for z<l asymptotically we have 0(z) ~ -4=, 
while 0 (z) ~ 1 + 2 e~ z for z S> 1 , we can isolate the singular parts of (d(s) writing 

) dz 
(C.5) 

Last expression can be readily continued to the region Re s < |. Using the property 
y/tQ(t) = 0 (t _1 ), we can write 
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D.l Normalization Factor 

Let’s compute the total number J\f of realizations of G M . Simple combinatorics 
gives M = (M\)\ E V We will rederive this results using delta functions and Lagrange 
multipliers. We have 

^=£IIIp(£< = i')- (CD 

{n} (i—tj) a \ b / 

Using Lagrange multipliers to expand the Kronecker deltas we obtain 
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where the second passage will be a posteriori justified. Using the relation 


e = e 


(a+b) 2 -(a-b) 2 r dxdy i_ 2 
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e poi integrando su A si ottiene 
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where we obtained the expected result in last equation passing through polar 
coordinates. 




159 


Publications 


[1] C. Lucibello, F. Morone, and T. Rizzo, “One-dimensional disordered Ising models 
by replica and cavity methods,” Physical Review E, vol. 90, July 2014. 

[2] U. Ferrari, C. Lucibello, F. Morone, G. Parisi, F. Ricci-Tersenghi, and T. Rizzo, 
“Finite-size corrections to disordered systems on Erdos-Renyi random graphs,” 
Physical Review B, vol. 88, Nov. 2013. 

[3] C. Lucibello, F. Morone, G. Parisi, F. Ricci-Ter senghi, and T. Rizzo, “Finite-size 
corrections to disordered Ising models on random regular graphs,” Physical 
Review E. vol. 90, July 2014. 

[4] C. Lucibello, F. Morone, G. Parisi, F. Ricci-Tersenghi, and T. Rizzo, “Anomalous 
finite size corrections in random field models,” Journal of Statistical Mechanics: 
Theory and Experiment , Oct. 2014. 

[5] S. Caracciolo, C. Lucibello, G. Parisi, and G. Sicuro, “A Scaling Hypothesis for 
the Euclidean Bipartite Matching Problem,” Physical Review E, vol. 90, Feb. 
2014. 

[6] C. Lucibello and F. Ricci-Tersenghi, “The Statistical Mechanics of Random 
Set Packing and a Generalization of the Karp-Sipser Algorithm,” International 
Journal of Statistical Mechanics , 2014. 




161 


Bibliography 


[7] J.-P. Bouchaud and M. Mezard, “Self induced quenched disorder: a model for 
the glass transition,” Journal de Physique I, vol. 4, pp. 1109-1114, Aug. 1994. 

[8] S. F. Edwards and P. W. Anderson, “Theory of spin glasses,” Journal of 
Physics F: Metal Physics, vol. 5, pp. 965-974, May 1975. 

[9] D. Sherrington and S. Kirkpatrick, “Solvable Model of a Spin-Glass,” Physical 
Review Letters, vol. 35, pp. 1792-1796, Dec. 1975. 

[10] G. Parisi, “Infinite Number of Order Parameters for Spin-Glasses,” Physical 
Review Letters, vol. 43, pp. 1754-1756, Dec. 1979. 

[11] G. Parisi, “Order Parameter for Spin-Glasses,” Phys. Rev. Lett., vol. 50, no. 24, 
pp. 1946-1948, 1983. 

[12] M. Mezard, G. Parisi, N. Sourlas, G. Toulouse, and M. A. Virasoro, “Nature 
of the Spin-Glass Phase,” Physical Review Letters, vol. 52, pp. 1156-1159, Mar. 
1984. 

[13] G. Parisi, M. Mezard, and M. A. Virasoro, Spin glass theory and beyond. World 
Scientific Singapore, 1987. 

[14] M. Mezard and G. Parisi, “The Bethe lattice spin glass revisited,” The European 
Physical Journal B, vol. 20, pp. 217-233, Mar. 2001. 

[15] A. Montanari and M. Mezard, Information, Physics and Computation. Oxford 
Univ. Press, 2009. 

[16] T. R. Kirkpatrick, D. Thirumalai, and P. G. Wolynes, “Scaling concepts for 
the dynamics of viscous liquids near an ideal glassy state,” Physical Review A, 
vol. 40, pp. 1045-1054, July 1989. 

[17] G. Parisi and F. Zamponi, “Mean-field theory of hard sphere glasses and 
jamming,” Reviews of Modern Physics, vol. 82, pp. 789-845, Mar. 2010. 

[18] M. Mezard and G. Parisi, “Replicas and optimization,” Journal de Physique 
Lettres, vol. 46, no. 17, pp. 771-778, 1985. 

[19] M. Mezard and G. Parisi, “Mean-Field Equations for the Matching and the 
Travelling Salesman Problems,” Europhysics Letters (EPL), vol. 2, pp. 913-918, 
Dec. 1986. 



162 


BIBLIOGRAPHY 


[20] M. Mezard, G. Parisi, and R. Zecchina, “Analytic and algorithmic solution of 
random satisfiability problems.,” Science, vol. 297, pp. 812-5, Aug. 2002. 

[21] G. Semerjian and R. Monasson, “Relaxation and metastability in a local search 
procedure for the random satisfiability problem,” Physical Review E, vol. 67, 
June 2003. 

[22] F. Krzakala, A. Montanari, F. Ricci-Tersenghi, G. Semerjian, and L. Zde¬ 
borova, “Gibbs states and the set of solutions of random constraint satisfaction 
problems.,” Proceedings of the National Academy of Sciences of the United 
States of America , vol. 104, pp. 10318-23, June 2007. 

[23] L. Zdeborova and F. Krzakala, “Phase transitions in the coloring of random 
graphs,” Physical Review E, vol. 3, pp. 1-37, 2007. 

[24] L. Dall’Asta, A. Ramezanpour, and P. Pin, “Statistical mechanics of maximal 
independent sets,” Physical Review E, vol. 80, p. 061136, Dec. 2009. 

[25] F. Morcos, A. Pagnani, B. Lunt, A. Bertolino, D. S. Marks, C. Sander, 
R. Zecchina, J. N. Onuchic, T. Hwa, and M. Weigt, “Direct-coupling analysis 
of residue coevolution captures native contacts across many protein families.,” 
Proceedings of the National Academy of Sciences of the United States of 
America , vol. 108, pp. E1293-301, Dec. 2011. 

[26] A. Decelle, F. Krzakala, C. Moore, and L. Zdeborova, “Asymptotic analy¬ 
sis of the stochastic block model for modular networks and its algorithmic 
applications,” Physical Review E, vol. 84, p. 066106, Dec. 2011. 

[27] A. Decelle and F. Ricci-Tersenghi, “Pseudolikelihood Decimation Algorithm 
Improving the Inference of the Interaction Network in a General Class of Ising 
Models,” Physical Review Letters , vol. 112, p. 070603, Feb. 2014. 

[28] H. Frauenfelder, S. Sligar, and P. G. Wolynes, “The energy landscapes and 
motions of proteins,” Science , vol. 254, pp. 1598-1603, Dec. 1991. 

[29] F. Krzakala, M. Mezard, F. Sausset, Y. F. Sun, and L. Zdeborova, “Statistical- 
Physics-Based Reconstruction in Compressed Sensing,” Physical Review X, 
vol. 2, p. 021005, May 2012. 

[30] G. Parisi, “A simple model for the immune network.,” Proceedings of the 
National Academy of Sciences of the United States of America, vol. 87, pp. 429- 
33, Jan. 1990. 

[31] E. Agliari, A. Barra, A. Galluzzi, F. Guerra, and F. Moauro, “Multitasking 
Associative Networks,” Physical Review Letters, vol. 109, p. 268101, Dec. 2012. 

[32] D. J. Arnit, H. Gutfreund, and H. Sompolinsky, “Spin-glass models of neural 
networks,” Physical Review A, vol. 32, pp. 1007-1018, Aug. 1985. 

[33] D. J. Arnit, Modeling brain function: The world of attractor neural networks. 
Cambridge University Press, 1992. 



BIBLIOGRAPHY 


163 


[34] R. Monasson and R. Zecchina, “Weight Space Structure and Internal Repre¬ 
sentations: A Direct Approach to Learning and Generalization in Multilayer 
Neural Networks,” Physical Review Letters, vol. 75, pp. 2432-2435, Sept. 1995. 

[35] A. Braunstein and R. Zecchina, “Learning by Message Passing in Networks of 
Discrete Synapses,” Physical Review Letters , vol. 96, p. 030201, Jan. 2006. 

[36] G. Semerjian, M. Tarzia, and F. Zamponi, “Exact solution of the Bose-Hubbard 
model on the Bethe lattice,” Physical Review B, vol. 80, p. 014524, July 2009. 

[37] G. Biroli, G. Semerjian, and M. Tarzia, “Anderson Model on Bethe Lattices: 
Density of States, Localization Properties and Isolated Eigenvalue,” Progress 
of Theoretical Physics Supplement, vol. 184, no. 184, pp. 187-199, 2010. 

[38] V. Bapst, L. Foini, F. Krzakala, G. Semerjian, and F. Zamponi, “The quantum 
adiabatic algorithm applied to random optimization problems: The quantum 
spin glass perspective,” Physics Reports, vol. 523, pp. 127-205, Feb. 2013. 

[39] F. Altarelli, A. Braunstein, L. Dall’Asta, A. Lage-Castellanos, and R. Zecchina, 
“Bayesian Inference of Epidemics on Networks via Belief Propagation,” Physical 
Review Letters, vol. 112, p. 118701, Mar. 2014. 

[40] D. Challet, M. Marsili, and R. Zecchina, “Statistical Mechanics of Systems 
with Heterogeneous Agents: Minority Games,” Physical Review Letters, vol. 84, 
pp. 1824-1827, Feb. 2000. 

[41] L. Dall’Asta, M. Marsili, and P. Pin, “Collaboration in social networks.,” 
Proceedings of the National Academy of Sciences of the United States of 
America, vol. 109, pp. 4395-400, Mar. 2012. 

[42] V. Folli, A. Puglisi, L. Leuzzi, and C. Conti, “Shaken Granular Lasers,” Physical 
Review Letters, vol. 108, p. 248002, June 2012. 

[43] U. Bastolla and G. Parisi, “The modular structure of Kauffman networks,” 
Physica D: Nonlinear Phenomena, vol. 115, pp. 219-233, May 1998. 

[44] M. Mezard, G. Parisi, and A. Zee, “Spectra of euclidean random matrices,” 
Nuclear Physics B, vol. 559, pp. 689-701, Oct. 1999. 

[45] T. Rogers, I. P. Castillo, R. Kiihn, and K. Takeda, “Cavity approach to the 
spectral density of sparse symmetric random matrices,” Phys. Rev. E, vol. 78, 
no. 3, p. 31116, 2008. 

[46] D. Sornette, A. Johansen, and J.-p. Bouchaud, “Stock Market Crashes, Pre¬ 
cursors and Replicas,” Journal de Physique I, vol. 6, pp. 167-175, Jan. 1996. 

[47] J.-P. Bouchaud and M. Potters, Theory of financial risk and derivative pricing: 
from statistical physics to risk management. Cambridge university press, 2003. 

[48] M. Mezard and G. Parisi, “Replica field theory for random manifolds,” Journal 
de Physique I, vol. 1, pp. 809-836, June 1991. 



164 


BIBLIOGRAPHY 


[49] F. Guerra, “Broken Replica Symmetry Bounds in the Mean Field Spin Glass 
Model,” Communications in Mathematical Physics , vol. 233, pp. 1-12, Feb. 
2003. 

[50] D. J. Aldous and J. M. Steele, “The Objective Method: Probabilistic Combi¬ 
natorial Optimization and Local Weak Convergence,” Probability on Discrete 
Structures , vol. 110, no. i, pp. 1-72, 2004. 

[51] M. Talagrand, Spin glasses: a challenge for mathematicians: cavity and mean 
field models. Springer, 2003. 

[52] A. Bovier, Statistical mechanics of disordered systems: A mathematical per¬ 
spective. Cambridge University Press, 2006. 

[53] A. J. Bray and M. A. Moore, “Scaling theory of the random-field Ising model,” 
Journal of Physics C: Solid State Physics , vol. 18, pp. L927-L933, Oct. 1985. 

[54] S. Franz and G. Parisi, “Universality classes of critical points in constrained 
glasses,” Journal of Statistical Mechanics: Theory and Experiment, vol. 2013, 
p. P11012, Nov. 2013. 

[55] G. Biroli, C. Cammarota, G. Tarjus, and M. Tarzia, “Random-Field-like Criti¬ 
cality in Glass-Forming Liquids,” Physical Review Letters, vol. 112, p. 175701, 
Apr. 2014. 

[56] G. Parisi and N. Sourlas, “Random Magnetic Fields, Supersymmetry, and 
Negative Dimensions,” Physical Review Letters, vol. 43, pp. 744-745, Sept. 
1979. 

[57] G. Tarjus, M. Baczyk, and M. Tissier, “Avalanches and Dimensional Reduction 
Breakdown in the Critical Behavior of Disordered Systems,” Physical Review 
Letters, vol. 110, p. 135703, Mar. 2013. 

[58] M. Mezard and G. Parisi, “The Euclidean matching problem,” Journal de 
Physique, vol. 49, no. 12, pp. 2019-2025, 1988. 

[59] J. Houdayer, J. H. Boutet de Monvel, and O. C. Martin, “Comparing mean 
field and Euclidean matching problems,” The European Physical Journal B, 
vol. 6, pp. 383-393, Nov. 1998. 

[60] O. C. Martin, M. Mezard, and O. Rivoire, “Random multi-index matching 
problems,” Journal of Statistical Mechanics: Theory and Experiment, vol. 2005, 
pp. P09006-P09006, Sept. 2005. 

[61] L. Zdeborova and M. Mezard, “The number of matchings in random graphs,” 
Journal of Statistical Mechanics: Theory and Experiment, vol. 2006, pp. P05003- 
P05003, May 2006. 

[62] F. Altarelli, A. Braunstein, A. Ramezanpour, and R. Zecchina, “Stochastic 
Matching Problem,” Physical Review Letters, vol. 106, May 2011. 

[63] M. E. J. Newman, Networks: an introduction. Oxford Univ. Press, 2010. 



BIBLIOGRAPHY 


165 


[64] G. Caldarelli, Scale-Free Networks: Complex Webs in Nature and Technology. 
Oxford Univ. Press, 2013. 

[65] B. Bollobas, Random Graphs. Cambridge University Press, 2001. 

[66] P. ErdASs and A. Renyi, “On Random Graphs, I,” Publicationes Mathematicae, 
vol. 6, 1959. 

[67] H. Zhou, “Long Range Frustrations in a Spin Glass Model of the Vertex Cover 
Problem,” London Mathematical Society Lecture Note Series, pp. 239-298, 
Nov. 2004. 

[68] B. Bollobas, “A Probabilistic Proof of an Asymptotic Formula for the Number 
of Labelled Regular Graphs,” European Journal of Combinatorics, vol. 1, 
pp. 311-316, Dec. 1980. 

[69] A. Steger and N. C. Wormald, “Generating random regular graphs quickly,” 
Combinatorics, Probability and Computing, vol. 8, 1999. 

[70] M. Molloy and B. Reed, “A critical point for random graphs with a given 
degree sequence,” Random Structures & Algorithms, vol. 6, pp. 161-180, Mar. 
1995. 

[71] N. C. Wormald, “The asymptotic distribution of short cycles in random regular 
graphs,” Journal of Combinatorial Theory, Series B, vol. 31, pp. 168-182, Oct. 
1981. 

[72] H.-A. Loeliger, “An Introduction to factor graphs,” IEEE Signal Processing 
Magazine, vol. 21, pp. 28-41, 2004. 

[73] C. De Dominicis and I. Giardina, Random fields and spin glasses. Cambridge 
University Press, 2006. 

[74] R. A. Banos, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, A. Gordillo- 
Guerrero, M. Guidetti, D. Iniguez, A. Maiorano, E. Marinari, V. Martin- 
Mayor, J. Monforte-Garcia, A. Muiioz Sudupe, D. Navarro, G. Parisi, S. Perez- 
Gaviro, J. J. Ruiz-Lorenzo, S. F. Schifano, B. Seoane, A. Tarancon, P. Tellez, 
R. Tripiccione, and D. Yllanes, “Thermodynamic glass transition in a spin 
glass without time-reversal symmetry.,” Proceedings of the National Academy 
of Sciences of the United States of America, vol. 109, pp. 6452-6, Apr. 2012. 

[75] M. A. Moore and A. J. Bray, “Disappearance of the de Almeida-Thouless line 
in six dimensions,” Physical Review B, vol. 83, p. 224408, June 2011. 

[76] M. Mezard and A. P. Young, “Replica Symmetry Breaking in the Random 
Field Ising Model,” Europhysics Letters (EPL), vol. 18, pp. 653-659, Apr. 
1992. 

[77] M. Mezard and R. Monasson, “Glassy transition in the three-dimensional 
random-field Ising model,” Physical Review B, vol. 50, pp. 7199-7202, Sept. 
1994. 



166 


BIBLIOGRAPHY 


[78] F. Krzakala, F. Ricci-Tersenghi, and L. Zdeborova, “Elusive Spin-Glass Phase 
in the Random Field Ising Model,” Physical Review Letters, vol. 104, p. 207208, 
May 2010. 

[79] M. Tissier and G. Tarjus, “Supersymmetry and Rs Spontaneous Breaking in 
the Random Field Ising Model,” Physical Review Letters , vol. 107, p. 041601, 
July 2011. 

[80] T. Natterman, Spin Glasses and Random Fields, vol. 12 of Series on Directions 
in Condensed Matter Physics. WORLD SCIENTIFIC, Dec. 1997. 

[81] M. Bayati, D. Shah, and M. Sharma, “Maximum weight matching via max- 
product belief propagation,” in Proceedings. International Symposium on 
Information Theory, 2005. ISIT 2005., pp. 1763-1767, IEEE, 2005. 

[82] J. S. Yedidia, W. T. Freeman, and Y. Weiss, “Constructing Free-Energy 
Approximations and Generalized Belief Propagation Algorithms,” IEEE Trans¬ 
actions on Information Theory, vol. 51, pp. 2282-2312, July 2005. 

[83] R. Kikuchi, “Superposition approximation and natural iteration calculation in 
cluster-variation method,” Journal of Chemical Physics, vol. 60, pp. 1071-1080, 
1974. 

[84] C. H. Papadimitriou and K. Steiglitz, Combinatorial optimization: algorithms 
and complexity. Courier Dover Publications, 1998. 

[85] S. Mertens, “Random Costs in Combinatorial Optimization,” Phys. Rev. Lett., 
vol. 84, pp. 1347-1350, Feb. 2000. 

[86] R. Monasson and R. Zecchina, “Statistical mechanics of the random K- 
satisfiability model,” Phys. Rev. E, vol. 56, no. 2, pp. 1357-1370, 1997. 

[87] J. S. Yedidia, W. T. Freeman, and Y. Weiss, “Understanding Belief Propagation 
and its Generalizations,” Exploring artificial intelligence in the new millennium, 
vol. 8, 2003. 

[88] H. W. Kuhn, “The Hungarian method for the assignment problem,” Naval 
Research Logistics Quarterly, vol. 2, 1955. 

[89] J. Munkres, “Algorithms for the Assignment and Transportation Problems,” 
Journal of the Society for Industrial and Applied Mathematics, vol. 5, pp. 32-38, 
Mar. 1957. 

[90] R. M. Karp and M. Sipser, “Maximum matching in sparse random graphs,” 
in 22nd Annual Symposium on Foundations of Computer Science, vol. 12, 
pp. 364-375, IEEE, Oct. 1981. 

[91] J. Edmonds, “Paths, trees, and flowers,” Canadian Journal of mathematics, 
vol. 17, no. 3, 1965. 

[92] M. Bayati, D. Shah, and M. Sharma, “Max-Product for Maximum Weight 
Matching: Convergence, Correctness, and LP Duality,” IEEE Transactions on 
Information Theory, vol. 54, pp. 1241-1251, Mar. 2008. 



BIBLIOGRAPHY 


167 


[93] A. G. Percus and O. C. Martin, “Finite size and dimensional dependence in 
the Euclidean traveling salesman problem.,” Physical review letters , vol. 76, 
pp. 1188-1191, Feb. 1996. 

[94] N. J. Cerf, O. Bohigas, O. C. Martin, A. G. Percus, and J. H. Boutet de 
Monvel, “The random link approximation for the Euclidean traveling salesman 
problem,” Journal de Physique Lettres, pp. 1-29, 1998. 

[95] G. Parisi and M. Ratieville, “On the finite size corrections to some random 
matching problems,” The European Physical Journal B, vol. 29, pp. 457-468, 
Oct. 2002. 

[96] E. Boniolo, S. Caracciolo, and A. Sportiello, “Correlation function for the 
Grid-Poisson Euclidean matching on a line and on a circle,” ArXiv e-prints, 
p. 29, Mar. 2014. 

[97] S. Caracciolo and G. Sicuro, “One-dimensional Euclidean matching problem: 
Exact solutions, correlation functions, and universality,” Physical Review E, 
vol. 90, p. 042112, Oct. 2014. 

[98] E. Trucco and A. Verri, Introductory techniques for 3-D computer vision. 
Prentice Hall Englewood Cliffs, 1998. 

[99] Y.-Y. Liu, J.-J. Slotine, and A.-L. Barabasi, “Controllability of complex 
networks.,” Nature, vol. 473, pp. 167-73, May 2011. 

[100] G. Menichetti, L. Dall’Asta, and G. Bianconi, “The controllability of networks 
is determined by the density of low in-degree and low out-degree nodes,” ArXiv 
e-prints, p. 9, May 2014. 

[101] D. Gusfield, Algorithms on strings, trees and sequences: computer science and 
computational biology. Cambridge University Press, 1997. 

[102] H. Zhou and Z.-c. Ou-Yang, “Maximum matching on random graphs,” ArXiv 
e-prints, Sept. 2003. 

[103] D. Gamarnik, T. Nowicki, and G. Swirszcz, “Maximum weight independent 
sets and matchings in sparse random graphs. Exact results using the local weak 
convergence method,” Random Structures and Algorithms, vol. 28, pp. 76-106, 
Jan. 2006. 

[104] D. J. Aldous, “The zeta(2) limit in the random assignment problem,” Random 
Structures and Algorithms, vol. 18, pp. 381-418, July 2001. 

[105] S. Linusson and J. Wastlund, “A proof of Parisi’s conjecture on the random 
assignment problem,” Probability Theory and Related Fields, vol. 128, pp. 419- 
440, Mar. 2004. 

[106] M. Bayati, D. Gamarnik, D. Katz, C. Nair, and P. Tetali, “Simple deterministic 
approximation algorithms for counting matchings,” in Proceedings of the thirty- 
ninth annual ACM symposium on Theory of computing, STOC ’07, (New York, 
NY, USA), pp. 122-127, ACM, 2007. 



168 


BIBLIOGRAPHY 


[107] B. DezsAS, A. Jiittner, and P. Kovacs, “LEMON aA§ an Open Source C++ 
Graph Template Library,” Electronic Notes in Theoretical Computer Science, 
vol. 264, pp. 23-45, July 2011. 

[108] G. Parisi and M. Ratieville, “Neighborhood preferences in random matching 
problems,” The European Physical Journal B , vol. 22, pp. 229-237, July 2001. 

[109] J. C. Picard and H. D. Ratliff, “Minimum cuts and related problems,” Networks, 
vol. 5, pp. 357-370, Oct. 1975. 

[110] A. V. Goldberg and R. E. Tarjan, “A New Approach to the Maximum-Flow 
Problem,” Journal of the ACM, vol. 35, no. 4, pp. 921-940, 1988. 

[111] A. K. Hartmann and H. Reiger, New Optimization Algorithms in Physics. 
Wiley, 2006. 

[112] S. Boettcher and A. G. Percus, “Extremal Optimzation: An Evolutionary 
Local-Search Algorithm,” Computational Modeling and Problem Solving in the 
Networked World, vol. 21, p. 17, Sept. 2003. 

[113] A. K. Hartmann, “Cluster-exact approximation of spin glass groundstates,” 
Physica A: Statistical Mechanics and its Applications, vol. 224, pp. 480-488, 
Feb. 1996. 

[114] M. Pelikan, Hierarchical Bayesian optimization algorithm. Springer, 2005. 

[115] A. K. Hartmann and M. Pelikan, “Searching for ground states of Ising spin 
glasses with hierarchical BOA and cluster exact approximation,” in Parallel 
Problem Solving from Nature, Springer, 2006. 

[116] G. Parisi, F. Ritort, and F. Slanina, “Critical finite-size corrections for the 
Sherrington-Kirkpatrick spin glass,” Journal of Physics A: Mathematical and 
General, vol. 26, pp. 247-259, Jan. 1993. 

[117] G. Parisi, F. Ritort, and F. Slanina, “Several results on the finite-size correc¬ 
tions in the Sherrington-Kirkpatrick spin-glass model,” Journal of Physics A: 
Mathematical and General, vol. 26, pp. 3775-3789, Aug. 1993. 

[118] A. Billoire, “Numerical estimate of the finite-size corrections to the free energy 
of the Sherrington-Kirkpatrick model using Guerra-Toninelli interpolation,” 
Physical Review B, vol. 73, p. 132201, Apr. 2006. 

[119] G. Parisi and T. Temesvari, “Replica symmetry breaking in and around six 
dimensions,” Nuclear Physics B, vol. 858, pp. 293-316, May 2012. 

[120] M. Pelikan and D. E. Goldberg, “Hierarchical Problem Solving by the Bayesian 
Optimization Algorithm,” in GECCO, no. 2000002, 2000. 

[121] M. Pelikan, A. K. Hartmann, and K. Sastry, “Hierarchical BOA, Cluster Exact 
Approximation, and Ising Spin Glasses,” no. 1, pp. 122-131, 2006. 



BIBLIOGRAPHY 


169 


[122] S. Boettcher, “Numerical results for ground states of spin glasses on Bethe 
lattices,” The European Physical Journal B - Condensed Matter , vol. 31, 
pp. 29-39, Jan. 2003. 

[123] S. Boettcher, “Extremal optimization for Sherrington-Kirkpatrick spin glasses,” 
The European Physical Journal B, vol. 46, pp. 501-505, Sept. 2005. 

[124] S. Boettcher, “Numerical results for spin glass ground states on Bethe lattices: 
Gaussian bonds,” The European Physical Journal B , vol. 74, pp. 363-371, Mar. 
2010. 

[125] S. Boettcher and S. Falkner, “Finite-size corrections for ground states of 
Edwards-Anderson spin glasses,” EPL (Europhysics Letters), vol. 98, p. 47005, 
May 2012. 

[126] P. Rujan, “Calculation of the free energy of Ising systems by a recursion 
method,” Physica A: Statistical Mechanics and its Applications, vol. 91, pp. 549- 
562, May 1978. 

[127] B. Derrida, J. Vannimenus, and Y. Pomeau, “Simple frustrated systems: 
chains, strips and squares,” Journal of Physics C: Solid State Physics, vol. 11, 
pp. 4749-4765, Dec. 1978. 

[128] B. Derrida and H. J. Hilhorst, “Singular behaviour of certain infinite products 
of random 2AU2 matrices,” Journal of Physics A: Mathematical and General, 
vol. 16, pp. 2641-2654, Aug. 1983. 

[129] G. Grinstein and D. Mukamel, “Exact solution of a one-dimensional Ising 
model in a random magnetic field,” Physical Review B, vol. 27, pp. 4503-4506, 
Apr. 1983. 

[130] T. M. Nieuwenhuizen and J. M. Luck, “Exactly soluble random field Ising 
models in one dimension,” Journal of Physics A: Mathematical and General, 
vol. 19, pp. 1207-1227, May 1986. 

[131] J. M. Luck and T. M. Nieuwenhuizen, “Correlation function of random-field 
Ising chains: is it Lorentzian or not?,” Journal of Physics A: Mathematical 
and General, vol. 22, pp. 2151-2180, June 1989. 

[132] J. M. Luck, M. Funke, and T. M. Nieuwenhuizen, “Low-temperature thermo¬ 
dynamics of random-held Ising chains: exact results,” Journal of Physics A: 
Mathematical and General, vol. 24, pp. 4155-4195, Sept. 1991. 

[133] B. Derrida, M. Mendes France, and J. Peyriere, “Exactly solvable one¬ 
dimensional inhomogeneous models,” Journal of Statistical Physics, vol. 45, 
pp. 439-449, Nov. 1986. 

[134] G. Forgacs, D. Mukamel, and R. Pelcovits, “Glauber Dynamics for One¬ 
dimensional Spin Models with Random Fields,” Physical Review B, vol. 30, 
pp. 205-208, July 1984. 



170 


BIBLIOGRAPHY 


[135] N. S. Skantzos and A. C. C. Coolen, “Random field Ising chains with syn¬ 
chronous dynamics,” Journal of Physics A: Mathematical and General, vol. 33, 
pp. 1841-1855, Mar. 2000. 

[136] D. S. Fisher, P. Le Doussal, and C. Monthus, “Nonequilibrium dynamics of 
random field Ising spin chains: Exact results via real space renormalization 
group,” Physical Review E, vol. 64, Nov. 2001. 

[137] A. C. C. Coolen and K. Takeda, “Transfer operator analysis of the parallel 
dynamics of disordered Ising chains,” Philosophical Magazine , vol. 92, pp. 64- 
77, Jan. 2012. 

[138] M. Weigt and R. Monasson, “Replica structure of one-dimensional Ising 
models,” EPL (Europhysics Letters), vol. 36, p. 4, Aug. 1996. 

[139] T. Nikoletopoulos and A. C. C. Coolen, “Diagonalization of replicated transfer 
matrices for disordered Ising spin systems,” Journal of Physics A: Mathematical 
and General, vol. 37, pp. 8433-8456, Sept. 2004. 

[140] G. Gyorgyi and P. Rujan, “Strange attractors in disordered systems,” Journal 
of Physics C: Solid State Physics, vol. 17, pp. 4207-4212, Aug. 1984. 

[141] G. Aeppli and R. Bruinsma, “Linear response theory and the one-dimensional 
Ising ferromagnet in a random field,” Physics Letters A, vol. 97, pp. 117-120, 
Aug. 1983. 

[142] R. Bruinsma and G. Aeppli, “One-Dimensional Ising Model in a Random 
Field,” Physical Review Letters, vol. 50, pp. 1494-1497, May 1983. 

[143] U. Behn and V. A. Zagrebnov, “One-dimensional Markovian-field Ising model: 
physical properties and characteristics of the discrete stochastic mapping,” 
Journal of Physics A: Mathematical and General, vol. 21, pp. 2151-2165, May 
1988. 

[144] F. Igloi, “Correlations in random Ising chains at zero temperature,” Journal 
of Physics A: Mathematical and General, vol. 27, pp. 2995-3005, May 1994. 

[145] K. Janzen and A. Engel, “Stability of the replica-symmetric saddle point in 
general mean-field spin-glass models,” Journal of Statistical Mechanics: Theory 
and Experiment, vol. 2010, p. P12002, Dec. 2010. 

[146] K. Janzen, A. Engel, and M. Mezard, “Thermodynamics of the Levy spin 
glass,” Physical Review E, vol. 82, Aug. 2010. 

[147] G. Parisi, F. Ricci-Tersenghi, and T. Rizzo, “Diluted mean-held spin-glass 
models at criticality,” Journal of Statistical Mechanics: Theory and Experiment, 
vol. 2014, p. P04013, Apr. 2014. 

[148] G. Parisi, “Field theory and the physics of disordered systems,” in PoS (HRMS), 
vol. 023, Jan. 2012. 



BIBLIOGRAPHY 


171 


[149] E. P. Wigner, Group theory and its application to the quantum mechanics of 
atomic spectra. New York, NY, USA: Academic Press, 1959. 

[150] A. J. Bray and M. A. Moore, “Replica symmetry and massless modes in the 
Ising spin glass,” Journal of Physics C: Solid State Physics , vol. 12, pp. 79-104, 
Jan. 1979. 

[151] J. R. L. de Almeida and D. J. Thouless, “Stability of the Sherrington- 
Kirkpatrick solution of a spin glass model,” Journal of Physics A: Mathematical 
and General , vol. 11, pp. 983-990, May 1978. 

[152] F. Morone, G. Parisi, and F. Ricci-Tersenghi, “Large deviations of correlation 
functions in random magnets,” Physical Review B, vol. 89, p. 214202, June 
2014. 

[153] M. Weigt, “A replica approach to products of random matrices,” Journal of 
Physics A: Mathematical and General , vol. 31, pp. 951-961, Jan. 1998. 

[154] M. Campellone, G. Parisi, and M. A. Virasoro, “Replica Method and Finite 
Volume Corrections,” Journal of Statistical Physics , vol. 138, pp. 29-39, Dec. 
2009. 

[155] B. Derrida, “Random-energy model: An exactly solvable model of disordered 
systems,” Physical Review B, vol. 24, pp. 2613-2626, Sept. 1981. 

[156] M. Mezard and G. Parisi, “On the solution of the random link matching 
problems,” Journal de Physique , vol. 48, no. 9, pp. 1451-1459, 1987. 

[157] A. Montanari and T. Rizzo, “How to compute loop corrections to the Bethe 
approximation,” Journal of Statistical Mechanics: Theory and Experiment, 
vol. 2005, pp. P10011-P10011, Oct. 2005. 

[158] F. Guerra and F. L. Toninelli, “The High Temperature Region of the Viana 
aA§ Bray Diluted Spin Glass Model,” Journal of Statistical Physics, vol. 115, 
no. April, pp. 531-555, 2004. 

[159] P. ErdASs and A. Renyi, “On the strength of connectedness of a random graph,” 
Acta Mathematica Academiae Scientiarum Hungaricae, vol. 12, pp. 261-267, 
Sept. 1961. 

[160] L. Viana and A. J. Bray, “Phase diagrams for dilute spin glasses,” Journal of 
Physics C: Solid State Physics , vol. 18, pp. 3037-3051, May 1985. 

[161] C. M. Fortuin, P. W. Kasteleyn, and J. Ginibre, “Correlation inequalities 
on some partially ordered sets,” Communications in Mathematical Physics, 
vol. 22, pp. 89-103, June 1971. 

[162] A. K. Hartmann and U. Nowak, “Universality in three dimensional random- 
field ground states,” The European Physical Journal B, vol. 7, pp. 105-109, 
Jan. 1999. 



172 


BIBLIOGRAPHY 


[163] A. A. Middleton and D. S. Fisher, “Three-dimensional random-held Ising 
magnet: Interfaces, scaling, and the nature of states,” Physical Review B, 
vol. 65, p. 134411, Mar. 2002. 

[164] P. Mottishaw and C. De Dominicis, “On the stability of randomly frustrated 
systems with finite connectivity,” Journal of Physics A: Mathematical and 
General , vol. 20, pp. L375-L379, Apr. 1987. 

[165] M. Mezard and G. Parisi, “Mean-Field Theory of Randomly Frustrated Systems 
with Finite Connectivity,” Europhysics Letters (EPL), vol. 3, pp. 1067-1074, 
May 1987. 

[166] I. Kanter and H. Sompolinsky, “Mean-held theory of spin-glasses with hnite 
coordination number,” Physical Review Letters , vol. 58, pp. 164-167, Jan. 
1987. 

[167] M. Chertkov and V. Y. Chernyak, “Loop calculus in statistical physics and 
information science,” Physical Review E. vol. 73, June 2006. 

[168] M. Chertkov and V. Y. Chernyak, “Loop series for discrete statistical models on 
graphs,” Journal of Statistical Mechanics: Theory and Experiment , vol. 2006, 
pp. P06009-P06009, June 2006. 

[169] T. Aspelmeier, M. A. Moore, and A. P. Young, “Interface Energies in Ising 
Spin Glasses,” Physical Review Letters , vol. 90, p. 127202, Mar. 2003. 

[170] G. Parisi and T. Rizzo, “Large Deviations in the Free Energy of Mean-Field 
Spin Glasses,” Physical Review Letters , vol. 101, Sept. 2008. 

[171] G. Parisi and T. Rizzo, “Phase diagram and large deviations in the free energy 
of mean-held spin glasses,” Physical Review B, vol. 79, Apr. 2009. 

[172] G. Parisi and T. Rizzo, “Large deviations of the free energy in diluted mean- 
held spin-glass,” Journal of Physics A: Mathematical and Theoretical , vol. 43, 
Jan. 2010. 

[173] Y. Y. Goldschmidt and C. De Dominicis, “Replica symmetry breaking in the 
spin-glass model on lattices with hnite connectivity: Application to graph 
partitioning,” Physical Review B , vol. 41, pp. 2184-2197, Feb. 1990. 

[174] T. Rizzo, A. Lage-Castellanos, R. Mulet, and F. Ricci-Tersenghi, “Replica 
Cluster Variational Method,” Journal of Statistical Physics, vol. 139, pp. 375- 
416, Mar. 2010. 

[175] V. Dotsenko and M. Mezard, “Vector breaking of replica symmetry in some 
low-temperature disordered systems,” Journal of Physics A: Mathematical and 
General, vol. 30, pp. 3363-3382, May 1997. 

[176] V. Dotsenko, “Non-perturbative phenomena in the three-dimensional random 
held Ising model,” Journal of Statistical Mechanics: Theory and Experiment, 
vol. 2006, pp. P06003-P06003, June 2006. 



BIBLIOGRAPHY 


173 


[177] G. Parisi, “A Conjecture on random bipartite matching,” ArXiv e-prints, Jan. 
1998. 

[178] C. Nair, B. Prabhakar, and M. Sharma, “Proofs of the Parisi and Coppersmith- 
Sorkin conjectures for the finite random assignment problem,” in ffth Annual 
IEEE Symposium on Foundations of Computer Science, 2003. Proceedings., 
pp. 168-178, IEEE Computer. Soc, 2003. 

[179] M. Talagrand, “Matching Random Samples in Many Dimensions,” The Annals 
of Applied Probability, vol. 2, pp. 846-856, Nov. 1992. 

[180] M. Ajtai, J. Komlos, and G. Tusnady, “On optimal matchings,” Combinatorica, 
vol. 4, pp. 259-264, Dec. 1984. 

[181] J. M. Steele, Probability theory and combinatorial optimization. Siam, 1997. 

[182] J. E. Yukich, Probability theory of classical Euclidean optimization problems. 
Springer, 1998. 

[183] V. I. Bogachev and A. V. Kolesnikov, “The Monge-Kantorovich problem: 
achievements, connections, and perspectives,” Russian Mathematical Surveys, 
vol. 67, pp. 785-890, Oct. 2012. 

[184] L. C. Evans, “Partial differential equations and Monge-Kantorovich mass 
transfer,” Current developments in mathematics, 1997. 

[185] C. Villani, Optimal transport: old and new. Springer, 2008. 

[186] G. H. Hardy, Ramanujan 1887-1920: Twelve Lectures on Subjects Suggested 
by His Life and Work. Chelsea, 1940. 

[187] C. Sanderson, “Armadillo: An open source C++ linear algebra library for fast 
prototyping and computationally intensive experiments,” tech, rep., NICTA, 
2010. 

[188] M. Cao and J. Machta, “Migdal-Kadanoff study of the random-field Ising 
model,” Physical Review B, vol. 48, pp. 3177-3182, Aug. 1993. 

[189] F. Igloi and C. Monthus, “Strong disorder RG approach of random systems,” 
Physics Reports, vol. 412, pp. 277-431, June 2005. 

[190] M. Angelini, G. Parisi, and F. Ricci-Tersenghi, “Ensemble renormalization 
group for disordered systems,” Physical Review B, vol. 87, p. 134201, Apr. 
2013. 

[191] C. De Dominicis, I. Kondor, and T. Temesvari, “Beyond the Sherrington- 
Kirkpatrick Model,” in Spin Glasses And Random Fields, World Scientific 
Singapore, 1997. 

[192] C. Cammarota, G. Biroli, M. Tarzia, and G. Tarjus, “Fragility of the mean-field 
scenario of structural glasses for disordered spin models in finite dimensions,” 
Physical Review B, vol. 87, p. 064202, Feb. 2013. 



174 


BIBLIOGRAPHY 


[193] G. Parisi and F. Slanina, “Loop expansion around the BetheaA§Peierls ap¬ 
proximation for lattice models,” Journal of Statistical Mechanics: Theory and 
Experiment , vol. 2006, pp. L02003-L02003, Feb. 2006. 

[194] J. M. Mooij, B. Wemmenhove, H. J. Kappen, and T. Rizzo, “Loop Corrected 
Belief Propagation,” in International Conference on Artificial Intelligence and 
Statistics , 2007. 

[195] P. O. Vontobel, “Counting in Graph Covers: A Combinatorial Characterization 
of the Bethe Entropy Function,” IEEE Transactions on Information Theory , 
vol. 59, pp. 6018-6048, Sept. 2013. 

[196] R. Mori and T. Tanaka, “New Generalizations of the Bethe Approximation 
via Asymptotic Expansion,” in IEICE SITA, p. 6, Oct. 2012. 

[197] R. Fitzner and R. van der Hofstad, “Non-backtracking Random Walk,” Journal 
of Statistical Physics , vol. 150, pp. 264-284, Jan. 2013. 

[198] D. S. Dean, “Metastable states of spin glasses on random thin graphs,” The 
European Physical Journal B, vol. 15, pp. 493-498, May 2000. 

[199] R. Contino and A. Gambassi, “On dimensional regularization of sums,” Journal 
of Mathematical Physics, vol. 44, no. 2, 2003. 



